-- Logs begin at Wed 2022-08-31 11:35:23 UTC, end at Wed 2022-08-31 13:08:18 UTC. -- Aug 31 12:09:53.929858 dv-cinder-855359-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 12:09:53.939069 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:09:53 2022] *** Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: nodename: dv-cinder-855359-1-iscsi Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: machine: x86_64 Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: clock source: unix Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: pcre jit disabled Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: detected number of CPU cores: 4 Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: current working directory: / Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: your processes number limit is 47680 Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: your memory page size is 4096 bytes Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: detected max file descriptor number: 2048 Aug 31 12:09:53.941104 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: lock engine: pthread robust mutexes Aug 31 12:09:53.942079 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: thunder lock: enabled Aug 31 12:09:53.942079 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 12:09:53.942079 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:09:53.982074 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: Python main interpreter initialized at 0x555d5d99f9c0 Aug 31 12:09:53.982074 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: python threads support enabled Aug 31 12:09:53.982074 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: your server socket listen backlog is limited to 100 connections Aug 31 12:09:53.982074 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:09:53.982524 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:09:53.982524 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: *** Operational MODE: preforking *** Aug 31 12:09:53.982786 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:09:53.982786 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: spawned uWSGI master process (pid: 105505) Aug 31 12:09:53.985919 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: spawned uWSGI worker 1 (pid: 105506, cores: 1) Aug 31 12:09:53.985919 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: spawned uWSGI worker 2 (pid: 105507, cores: 1) Aug 31 12:09:53.985919 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:09:53.983016 dv-cinder-855359-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 12:09:54.637171 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:09:54.645832 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:09:55.706913 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:09:55.706913 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: from cryptography.utils import int_from_bytes Aug 31 12:09:55.707898 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:09:55.707898 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: from cryptography.utils import int_from_bytes Aug 31 12:09:55.708339 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:09:55.708339 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: from cryptography.utils import int_from_bytes Aug 31 12:09:55.708826 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:09:55.708826 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: from cryptography.utils import int_from_bytes Aug 31 12:09:58.157592 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:09:58.158348 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:09:58.158348 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:09:58.159003 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:09:58.159003 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:09:58.159299 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:09:58.159464 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:09:58.159625 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:09:58.159768 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:09:58.159910 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:09:58.160050 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.160651 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.160921 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161081 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161231 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161370 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161519 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161682 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161825 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.161971 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.162115 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.162247 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.162405 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.162405 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.162758 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.162894 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163041 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163173 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163378 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163510 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163656 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163787 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-1-iscsi {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.163923 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164065 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164308 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-1-iscsi {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164453 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164585 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164585 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164830 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.164984 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165119 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165264 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165413 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165545 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165679 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165810 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.165925 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166048 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166163 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166298 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166437 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166551 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166686 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166804 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.166916 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167027 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167148 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167283 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167402 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167518 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167658 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167795 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.167924 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168048 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168176 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168316 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168468 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168614 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168759 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.168908 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.169091 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-1-iscsi {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.169264 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-1-iscsi {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.169403 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.169604 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.169748 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170037 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170191 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170332 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170459 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170600 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170733 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170865 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.170996 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.171178 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.171378 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.171520 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.171692 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.171849 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.172000 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.172166 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.172313 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.172505 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.172677 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.172888 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173028 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173169 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173314 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173471 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173597 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173749 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.173879 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174012 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174162 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174294 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174426 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174569 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174698 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.174866 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.175054 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.175187 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.175384 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.175514 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.175680 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.175820 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176083 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176231 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176375 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176506 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176642 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176777 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.176909 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177032 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177155 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177290 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177430 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177568 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177688 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177811 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.177944 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.178090 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.178255 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.178388 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.178589 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.178752 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.178895 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179033 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179157 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179353 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179521 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179659 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179782 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.179916 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.180098 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.180248 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.180414 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.180627 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.180790 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.180956 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.181111 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.181276 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.181431 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.181585 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.181737 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.181898 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.182052 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.182219 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.182381 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.182534 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.182737 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.182859 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183079 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183260 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183405 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183532 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183666 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183798 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.183919 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184041 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184164 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184294 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184426 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184555 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184677 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.184810 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185021 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185185 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185345 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185480 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185613 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185737 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185860 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.185999 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.186121 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.186335 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.186499 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.186647 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.186772 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.186918 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187041 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187172 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187322 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187521 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187702 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187844 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.187988 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.188111 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.188244 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.188412 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.188545 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.188713 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.188845 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189048 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189212 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189355 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189481 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189683 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189812 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.189936 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190059 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190202 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190336 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190504 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190639 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190796 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.190921 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.191101 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.191303 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.191428 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.191571 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.191813 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.191988 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.192120 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.192259 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.192400 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.192617 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.192802 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.192953 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193081 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193220 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193345 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193487 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193610 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193813 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.193994 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.194203 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.194325 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.194448 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.194581 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.194729 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.194856 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195070 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195252 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195394 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195522 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195661 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195785 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.195964 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.196090 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.196276 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.196398 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.196581 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.196702 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.196886 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197021 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197188 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197313 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197492 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197633 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197793 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.197916 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.198095 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.198229 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.198396 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.198531 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.198703 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.198826 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199000 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199125 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199313 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199452 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199628 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199818 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.199958 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200095 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200218 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200362 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200530 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200712 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.200985 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.201157 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.201274 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.201466 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.201608 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.201774 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.201902 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.202097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:09:58.202225 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.202428 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.202557 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.202763 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.202892 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.203080 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.203218 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.203400 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.203523 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.203720 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.203919 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204052 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204133 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204344 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204476 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204652 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204791 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.204964 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.205100 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.205284 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.205420 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.205601 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.205746 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.205933 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206072 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206306 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206465 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206613 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206747 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206870 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.206995 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.207204 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.207531 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.207661 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.207866 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.207994 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.208219 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.208360 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.208530 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.208659 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.208871 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.209002 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.209191 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.209328 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.209514 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.209651 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.209850 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.210032 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.210188 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.210340 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.210505 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.210700 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.210871 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.211035 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.211190 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.211440 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.211595 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.211766 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.211921 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.212078 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.212232 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.212384 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.212537 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.212700 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.212869 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213031 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213202 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213354 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213507 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213670 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213822 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.213986 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.214189 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.214353 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.214516 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.214678 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.214832 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.214984 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.215136 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.215358 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.215532 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.215702 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.215857 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216008 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216169 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216322 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216485 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216652 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216807 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.216960 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.217120 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.217285 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.217518 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.217674 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.217830 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.217982 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.218136 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.218297 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.218450 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.218602 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.218755 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.218755 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.219056 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.219256 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.219431 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.219587 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220078 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220078 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220380 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220515 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220645 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220766 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.220941 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221063 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221198 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221334 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221472 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221594 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221734 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221734 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.221993 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222115 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222238 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222369 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222490 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222622 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222799 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.222921 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.223044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.223174 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.223517 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.223650 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.223793 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.223915 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224037 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224170 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224313 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224453 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224585 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224705 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224828 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.224950 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225081 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225347 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225468 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225597 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225726 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225848 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.225981 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.226112 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.226234 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.226407 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.226530 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.226727 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.226884 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.227067 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.227365 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.227526 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.227680 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.227834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.227999 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.228154 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.228308 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.228461 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.228614 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.228776 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.228929 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.229090 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.229252 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.229406 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.229567 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.229734 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.229897 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230051 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230221 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230408 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230524 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230649 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230755 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230856 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.230976 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.231153 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.231300 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.231438 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.231561 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.231719 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.231844 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232032 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232171 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232344 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232467 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232653 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232814 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.232967 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.233101 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.233279 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.233411 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.233590 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.233723 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.233898 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234031 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234209 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234348 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234529 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234653 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234833 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.234971 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.235155 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.235297 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.235493 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.235621 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.235803 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.235929 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.236112 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.236235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.236418 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.236554 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.236737 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.236885 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237048 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237186 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237361 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237493 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237676 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237801 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.237992 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.238125 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.238598 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.238747 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.238886 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239018 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239152 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239375 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239512 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239634 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239768 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.239890 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240012 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240159 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240283 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240470 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240606 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240792 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.240918 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.241121 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.241303 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.241437 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.241560 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.241753 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.241885 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242063 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242200 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242374 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242500 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242682 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242807 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.242988 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.243113 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.243341 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.243469 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.243651 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.243786 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.243967 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.244149 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.244272 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.244406 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.244584 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.244735 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.244887 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.245025 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.245207 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.245353 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.245508 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.245630 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.245821 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246129 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246129 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246379 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246500 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246635 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246757 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.246905 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247028 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247165 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247433 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247561 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247682 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247814 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.247970 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.248101 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.248278 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.248411 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.248583 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.248717 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.248883 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249020 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249189 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249324 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249510 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249635 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249819 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.249942 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.250124 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.250259 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.250428 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.250606 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.250737 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.250860 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251030 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251155 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251362 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251514 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251661 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251785 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.251966 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.252105 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.252281 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.252405 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.252584 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.252723 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.252974 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253121 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253243 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253375 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253496 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253624 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253789 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.253993 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.254177 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.254304 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.254487 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.254612 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.254815 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.255002 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.255157 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.255368 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.255533 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.255686 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.255852 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256017 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256172 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256324 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256477 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256630 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256791 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.256944 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.257118 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.257271 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.257455 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.257638 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.257803 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.257956 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.258152 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.258344 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.258497 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.258664 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.258850 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.258974 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259096 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259287 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259415 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259556 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259678 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259800 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.259922 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260043 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260164 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260295 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260417 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260540 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260724 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260849 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.260975 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261109 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261230 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261351 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261478 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261652 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261775 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.261911 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.262033 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.262157 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.262288 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.262433 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.262749 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.262878 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.263063 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.263189 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.263407 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.263535 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.263738 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.263874 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264051 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264177 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264368 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264509 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264683 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264832 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.264999 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.265136 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.265307 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.265431 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.265610 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.265746 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.265916 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.266192 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.266318 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.266504 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.266627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.266813 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.266947 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.267118 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.267317 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.267446 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.267568 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.267743 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.267866 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268005 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268152 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268310 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268435 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268609 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268748 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.268913 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.269037 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.269216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.269341 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.269560 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.269685 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.269964 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.270094 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.270275 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.270402 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271047 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271171 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271171 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271430 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271565 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271693 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271834 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.271958 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272089 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272219 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272343 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272466 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272598 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272721 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272845 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.272968 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273096 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273228 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273352 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273483 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273605 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273727 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273849 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.273981 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.274214 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.274352 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.274476 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.274615 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.274794 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.274932 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.275106 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.275274 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.275417 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.275541 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.275764 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.275910 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276070 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276195 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276373 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276498 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276681 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276807 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.276988 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.277113 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.277297 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.277432 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.277606 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.277732 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.277919 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278067 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278222 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278348 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278527 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278665 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278840 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.278966 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.279143 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.279295 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.279472 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.279609 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.279774 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.279899 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280081 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280222 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280385 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280511 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280689 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280815 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.280995 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.281146 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.281282 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.281407 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.281605 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.281806 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.281962 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.282131 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.282287 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.282442 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.282606 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.282765 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.282926 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.283087 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.283283 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.283440 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.283593 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.283744 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.283912 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284065 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284217 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284377 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284536 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284707 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284847 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.284970 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285090 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285274 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285399 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285521 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285653 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285774 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.285896 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286017 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286139 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286269 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286408 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286530 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286652 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286774 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.286951 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.287088 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.287269 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.287396 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.287573 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.287715 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.287880 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288025 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288181 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288307 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288482 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288616 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288782 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.288921 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.289082 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.289207 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.289387 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.289512 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.289687 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.289824 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290004 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290131 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290309 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290437 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290610 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290744 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.290910 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291035 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291207 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291383 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291524 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291645 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291841 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.291986 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.292137 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.292263 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.292437 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.292562 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.292745 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.292879 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293054 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293177 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293382 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293506 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293687 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293811 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.293998 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.294131 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.294305 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.294439 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.294603 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.294729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.294914 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295048 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295253 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295401 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295551 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295676 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295855 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.295992 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.296176 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.296303 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.296483 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.296608 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.296794 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.296931 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.297133 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.297256 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.297419 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.297544 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.297729 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.297944 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298122 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298244 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298377 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298500 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298641 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298763 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.298890 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299013 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299200 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299388 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299531 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299656 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299830 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.299956 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.300139 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.300265 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.300446 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.300580 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.300752 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.300903 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.301439 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.301572 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.301742 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.301869 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.301992 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302117 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302242 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302401 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302535 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302666 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302789 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.302912 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303045 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303182 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303373 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303505 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303629 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303752 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.303885 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304021 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304149 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304271 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304405 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304578 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304773 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.304914 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.305084 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.305219 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.305398 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.305557 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.305692 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.305817 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306027 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306212 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306335 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306463 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306610 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306731 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.306892 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.307017 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.307195 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.307368 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.307626 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.307750 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.307934 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308057 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308248 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308389 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308552 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308678 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308854 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.308980 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.309156 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.309293 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.309467 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.309601 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.309788 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.309925 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.310090 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.310228 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.310391 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.310515 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.310692 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.310827 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.311010 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.311180 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.311330 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.311521 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.311647 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.311841 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.312053 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.312225 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.312349 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.312476 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.312660 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.312844 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313038 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313194 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313348 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313509 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313661 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313823 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.313990 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.314162 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.314343 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.314518 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.314672 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.314831 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.315008 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.315162 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.315341 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.315519 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.315519 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.315821 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.316071 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.316246 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.316467 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.316621 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.316858 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.316858 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.317173 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.317328 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.317497 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.317659 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.317812 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.317966 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.318119 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.318308 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.318482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.318636 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.318788 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.318788 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.319110 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.319301 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.319459 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.319621 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.319784 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.319946 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.320106 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.320268 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.320434 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.320601 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.320756 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.320908 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.321061 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.321227 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.321388 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.321542 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.321696 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.321696 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322026 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322198 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322322 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322444 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322568 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322694 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.322878 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323019 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323141 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323281 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323404 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323526 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323663 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323785 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.323907 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324031 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324153 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324278 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324411 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324533 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324670 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324792 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.324913 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325057 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325189 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325312 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325433 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325567 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325738 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.325875 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326037 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326161 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326353 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326487 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326667 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326807 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.326976 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.327099 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.327317 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.327442 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.327618 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.327790 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.327917 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328044 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328244 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328368 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328550 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328673 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328871 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.328996 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.329195 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.329319 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.329505 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.329629 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.329821 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.329944 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.330131 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.330253 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.330441 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.330581 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.330746 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.330874 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331046 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331171 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331379 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331502 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331686 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331802 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.331996 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.332185 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.332315 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.332441 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.332696 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.332858 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333012 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333157 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333330 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333458 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333631 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333757 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.333959 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.334098 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.334265 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.334402 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.334588 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.334725 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.334895 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.335060 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.335187 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.335354 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.335517 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.335642 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.335825 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336031 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336155 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336282 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336408 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336543 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336748 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336873 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.336998 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.337123 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.337302 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.337427 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.337608 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.337734 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.337936 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.338064 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.338248 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.338386 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.338574 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.338718 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.338881 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339005 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339192 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339364 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339534 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339674 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339840 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.339967 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.340150 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.340292 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.340463 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.340589 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.340778 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.340913 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.341099 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.341314 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.341441 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.341645 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.341770 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.341961 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.342101 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.342273 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.342397 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.342584 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.342711 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.342903 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.343059 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.343266 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.343386 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.343553 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.343687 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.343861 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.344007 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.344182 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.344305 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.344465 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.344591 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.345109 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.345288 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.345443 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.345643 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.345800 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.345986 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.346170 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.346336 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.346491 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.346653 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.346815 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.346978 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.347140 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.347319 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.347475 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.347639 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.347848 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.348016 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.348224 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.348390 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.348544 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.348708 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.348915 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.349078 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.349240 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.349393 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.349546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.349698 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.349861 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350024 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350180 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350345 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350500 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350653 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350825 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.350981 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.351134 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.351316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.351481 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.351636 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.351798 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.351952 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.352106 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.352271 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.352433 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.352596 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.352758 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.352902 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.353027 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.353329 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.353486 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.353657 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.353812 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.353965 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.354118 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.354118 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.354434 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.354595 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.354751 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.354904 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.355058 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.355226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.355412 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.355578 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.355745 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.355900 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356066 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356249 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356386 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356510 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356633 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356755 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.356886 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357009 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357140 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357272 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357402 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357533 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357664 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357787 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.357922 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.358130 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.358253 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.358425 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.358574 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.358717 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.358902 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.359039 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.359284 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.359416 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.359582 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.359864 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.359990 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.360214 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.360340 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.360528 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.360652 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.360841 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.360964 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.361153 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.361287 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.361467 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.361590 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.361774 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.361900 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.362081 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.362205 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.362389 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.362522 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.362693 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.362858 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.363005 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.363127 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.363420 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.363573 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.363716 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.363868 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.364048 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.364251 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.364377 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.364610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.364735 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.364932 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365056 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365237 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365402 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365541 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365666 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365854 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.365979 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.366161 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.366425 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.366552 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.366676 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.366798 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.366921 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367046 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367297 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367440 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367564 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367695 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367819 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.367943 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368076 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368209 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368333 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368515 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368642 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368815 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.368963 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.369129 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.369251 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.369413 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.369547 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.369722 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.369848 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370025 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370161 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370341 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370474 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370665 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370802 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.370986 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.371111 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.371311 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.371440 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.371636 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.371784 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.371927 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372049 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372208 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372332 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372516 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372669 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372823 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.372961 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.373128 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.373273 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.373448 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.373636 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.373761 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.373894 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.374054 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.374289 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.374416 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.374624 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.374748 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.374946 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.375073 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.375296 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.375428 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.375628 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.375753 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.375935 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376059 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376237 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376361 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376544 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376675 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376851 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.376986 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.377160 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.377287 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.377469 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.377593 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.377777 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.377910 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.378085 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.378222 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.378391 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.378643 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.378778 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.379077 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.380337 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.380471 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.380597 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.380735 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.380859 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.380992 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381123 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381257 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381383 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381505 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381638 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381759 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.381884 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382006 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382128 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382251 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382384 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382507 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382629 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382751 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382876 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.382998 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.383130 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.383283 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.383412 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.383592 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.383768 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.383904 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384027 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384149 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384270 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384402 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384526 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384663 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384786 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.384909 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385031 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385153 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385276 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385409 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385573 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385706 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385828 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.385961 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386104 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386231 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386357 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386482 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386608 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386732 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386873 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.386994 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.387120 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.387288 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.387428 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.387603 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.387746 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.387913 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.388042 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.388233 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.388359 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.388542 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.388670 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.388872 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389008 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389355 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389673 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389854 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.389991 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.390163 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.390288 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.390465 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.390591 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.390768 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.390895 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.391075 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.391218 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.391417 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.391542 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.391725 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.391853 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392026 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392165 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392329 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392455 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392635 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392761 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.392936 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.393076 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.393239 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.393365 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.393545 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.393726 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.393912 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.394056 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.394182 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.394312 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.394442 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.394649 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.395191 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.395407 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.395529 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.395654 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.395781 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.395906 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396051 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396177 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396302 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396650 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396771 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.396912 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397036 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397162 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397297 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397422 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397545 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397683 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397827 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.397951 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398087 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398212 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398349 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398482 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398615 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398740 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398865 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.398990 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.399132 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.399288 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.399466 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.399594 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.399775 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.399902 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.400083 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.400209 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.400390 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.400518 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.400703 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.400829 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401010 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401136 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401317 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401445 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401621 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401761 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.401928 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402053 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402231 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402357 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402536 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402673 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402843 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.402978 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.403152 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.403338 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.403501 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.403652 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.403828 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.403959 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.404132 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.404261 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.404453 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.404581 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.404771 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.404897 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.405088 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.405214 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.405401 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.405527 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.405707 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.405835 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406031 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406229 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406366 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406490 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406617 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406752 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.406925 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.407051 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.407257 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.407408 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.407565 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.407756 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.407905 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408045 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408169 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408298 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408473 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408599 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408789 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.408935 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.409104 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.409241 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.409423 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.409561 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.409746 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.409892 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.410052 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.410319 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.410560 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.410958 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411107 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411272 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411272 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411530 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411658 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411797 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.411936 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412060 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412188 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412315 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412443 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412568 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412707 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412833 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.412961 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.413087 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.413214 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:09:58.413358 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.413589 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.413912 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.414247 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.414580 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.414897 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.415267 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.415588 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.415938 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.416256 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.416605 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.416941 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.417259 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.417575 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.417887 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:09:58.418135 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:09:58.567757 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Registered counter for database nova_api Aug 31 12:09:58.572529 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO dbcounter [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Registered counter for database nova_api Aug 31 12:09:58.589599 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.592573 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_db.sqlalchemy.engines [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.597019 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.600047 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writer thread running {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.653174 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.context [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d768c00b-9249-4c6a-9bd1-79d66da87324(cell1) {{(pid=105507) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:09:58.656629 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.context [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d768c00b-9249-4c6a-9bd1-79d66da87324(cell1) {{(pid=105506) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:09:58.657054 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:09:58.657520 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:09:58.659166 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:09:58.659859 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:09:58.660316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:09:58.660550 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:09:58.660987 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:09:58.662410 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:09:58.662749 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:09:58.663523 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:09:58.663974 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:09:58.664451 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Registered counter for database nova_cell0 Aug 31 12:09:58.665967 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:09:58.668048 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO dbcounter [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Registered counter for database nova_cell0 Aug 31 12:09:58.668621 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Registered counter for database nova_cell1 Aug 31 12:09:58.672368 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO dbcounter [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Registered counter for database nova_cell1 Aug 31 12:09:58.676224 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.679339 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.679685 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_db.sqlalchemy.engines [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.684093 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writer thread running {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.684275 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.684732 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_db.sqlalchemy.engines [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.686499 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.821803 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writer thread running {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.831020 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO dbcounter [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Registered counter for database nova_cell0 Aug 31 12:09:58.832524 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Registered counter for database nova_cell0 Aug 31 12:09:58.840366 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_db.sqlalchemy.engines [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.843997 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:09:58.845663 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writer thread running {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:58.850389 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:09:59.179674 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: WARNING keystonemiddleware.auth_token [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:09:59.186960 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: WARNING keystonemiddleware.auth_token [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:09:59.207663 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:09:59.215085 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:09:59.525702 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: WARNING keystonemiddleware.auth_token [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:09:59.531741 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: WARNING keystonemiddleware.auth_token [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:09:59.537002 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555d5d99f9c0 pid: 105506 (default app) Aug 31 12:09:59.539080 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:09:59.540310 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Aug 31 12:09:59.540715 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Wed Aug 31 12:09:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:09:59.571826 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:09:59.577981 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-6bf44d8d-4b0d-4c77-8890-53e6e05b0a55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:09:59.584057 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555d5d99f9c0 pid: 105507 (default app) Aug 31 12:11:19.690553 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:19.691807 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001812 Aug 31 12:11:19.692290 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:19.714681 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:19.715671 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell1:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:19.716465 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:19.717597 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:20.710136 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-890e705d-4abb-484d-96a5-4197abc1d2f3 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:20.751196 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-890e705d-4abb-484d-96a5-4197abc1d2f3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.049446 Aug 31 12:11:20.764118 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 31 12:11:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:11:23.158984 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:23.160405 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-5f2c5530-a99d-4e83-98ec-7851896a96f2 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Aug 31 12:11:23.161150 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:23.634691 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-aa00de06-10df-4ce7-b088-34165dc4c02c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "id": "c1", "name": "cirros256"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:23.685787 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-aa00de06-10df-4ce7-b088-34165dc4c02c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.517776 Aug 31 12:11:23.686728 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:23.700333 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_api:SELECT=3 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:23.701448 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_cell0:SELECT=3 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:23.702197 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_cell1:SELECT=3 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:23.703308 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:23.909847 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-674b98cb-45e1-4630-bb6f-89b04c700abe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:23.971923 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-674b98cb-45e1-4630-bb6f-89b04c700abe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276709 Aug 31 12:11:23.972944 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 31 12:11:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:26.444732 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-aa00de06-10df-4ce7-b088-34165dc4c02c admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:26.445646 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-aa00de06-10df-4ce7-b088-34165dc4c02c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 31 12:11:26.446306 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:11:27.633382 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-5f14b90f-a226-45a1-aee4-dab0a031cae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:27.706435 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-5f14b90f-a226-45a1-aee4-dab0a031cae4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.252397 Aug 31 12:11:27.707371 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:11:27.728983 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-9fc9e537-191d-45c7-bc37-bb85f710c11a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:27.799059 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-9fc9e537-191d-45c7-bc37-bb85f710c11a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076603 Aug 31 12:11:27.800292 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 31 12:11:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:30.978635 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-5f14b90f-a226-45a1-aee4-dab0a031cae4 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:30.980254 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-5f14b90f-a226-45a1-aee4-dab0a031cae4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002616 Aug 31 12:11:30.980877 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:31.539500 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-aa0d616f-9558-444c-884a-07255559ca9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:31.568171 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-aa0d616f-9558-444c-884a-07255559ca9d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.575071 Aug 31 12:11:31.568909 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:31.584597 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-f12f7320-d5f8-4e56-9d51-70585d6466ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:31.614042 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-f12f7320-d5f8-4e56-9d51-70585d6466ed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034257 Aug 31 12:11:31.614759 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 31 12:11:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:34.381834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-aa0d616f-9558-444c-884a-07255559ca9d admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:34.383521 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-aa0d616f-9558-444c-884a-07255559ca9d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002329 Aug 31 12:11:34.384203 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:34.962645 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-31f6017e-dd54-41eb-9a2a-df961bdcbfb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:34.987460 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-31f6017e-dd54-41eb-9a2a-df961bdcbfb7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.595542 Aug 31 12:11:34.991295 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:35.008716 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-9d1a01ed-fa10-4e39-ae8e-8b1d5eecd361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:35.055190 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-9d1a01ed-fa10-4e39-ae8e-8b1d5eecd361 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053054 Aug 31 12:11:35.071269 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 31 12:11:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:38.098650 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-31f6017e-dd54-41eb-9a2a-df961bdcbfb7 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:38.100528 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-31f6017e-dd54-41eb-9a2a-df961bdcbfb7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Aug 31 12:11:38.101316 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:38.797978 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-da731359-ba3b-4229-acf1-ee51aff8c3d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:38.820423 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-da731359-ba3b-4229-acf1-ee51aff8c3d9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.711481 Aug 31 12:11:38.821086 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:38.834957 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-720fd850-91ab-4b47-bbdc-d81a74e6b2a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:38.868039 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-720fd850-91ab-4b47-bbdc-d81a74e6b2a0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036380 Aug 31 12:11:38.871798 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 31 12:11:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:41.847916 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-da731359-ba3b-4229-acf1-ee51aff8c3d9 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:41.849901 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-da731359-ba3b-4229-acf1-ee51aff8c3d9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002739 Aug 31 12:11:41.851030 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:42.456455 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-1e12c333-4cba-45b7-8250-6622e20a6aa1 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:42.490028 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-1e12c333-4cba-45b7-8250-6622e20a6aa1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.625442 Aug 31 12:11:42.490706 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 31 12:11:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:11:45.126410 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-da731359-ba3b-4229-acf1-ee51aff8c3d9 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:45.128390 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-da731359-ba3b-4229-acf1-ee51aff8c3d9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002320 Aug 31 12:11:45.128829 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:45.590434 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-6b5c3d6d-02eb-414b-a5f6-160c44614a94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:45.612059 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-6b5c3d6d-02eb-414b-a5f6-160c44614a94 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476334 Aug 31 12:11:45.612637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:45.626254 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-405c7314-f1bf-4c24-9160-be138844ae7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:45.653909 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-405c7314-f1bf-4c24-9160-be138844ae7b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031833 Aug 31 12:11:45.654669 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 31 12:11:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:48.149295 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-6b5c3d6d-02eb-414b-a5f6-160c44614a94 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:48.150332 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-6b5c3d6d-02eb-414b-a5f6-160c44614a94 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 31 12:11:48.150732 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:11:48.687407 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-e640f486-dfb5-4b75-b2cc-7ae04a381078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "id": "2"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:48.712847 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-e640f486-dfb5-4b75-b2cc-7ae04a381078 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.554709 Aug 31 12:11:48.713727 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:48.728078 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-8d0a99a4-1f74-4cd5-99c9-72e8f94ff31d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:48.759136 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-8d0a99a4-1f74-4cd5-99c9-72e8f94ff31d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034754 Aug 31 12:11:48.759957 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 31 12:11:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:51.333484 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-e640f486-dfb5-4b75-b2cc-7ae04a381078 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:51.335930 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-e640f486-dfb5-4b75-b2cc-7ae04a381078 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002968 Aug 31 12:11:51.337210 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:51.877767 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-e2ea6edb-62df-4f64-ab1d-bdc92d64ccea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:51.901511 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-e2ea6edb-62df-4f64-ab1d-bdc92d64ccea admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.554823 Aug 31 12:11:51.902631 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:51.919743 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-db053eed-b72f-4196-b742-a9fedbb1ae05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:51.930938 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:51.984698 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-db053eed-b72f-4196-b742-a9fedbb1ae05 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070673 Aug 31 12:11:51.986176 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 31 12:11:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:54.542459 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-e2ea6edb-62df-4f64-ab1d-bdc92d64ccea admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:54.543728 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-e2ea6edb-62df-4f64-ab1d-bdc92d64ccea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Aug 31 12:11:54.544574 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:55.199024 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-9c31dd3e-f75e-450c-a047-4dbcd711bb0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:55.220795 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-9c31dd3e-f75e-450c-a047-4dbcd711bb0c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.669606 Aug 31 12:11:55.227288 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:55.238778 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-d1b3c3ac-3a16-465a-9264-5347c3c1026a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:55.247668 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:55.287488 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-d1b3c3ac-3a16-465a-9264-5347c3c1026a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056148 Aug 31 12:11:55.288956 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 31 12:11:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:11:57.865776 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-9c31dd3e-f75e-450c-a047-4dbcd711bb0c admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:11:57.866697 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-9c31dd3e-f75e-450c-a047-4dbcd711bb0c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 31 12:11:57.867104 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:11:58.360304 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-f96d77d4-800e-4949-96f9-480cc4303502 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:58.419999 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-f96d77d4-800e-4949-96f9-480cc4303502 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.536210 Aug 31 12:11:58.420954 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 31 12:11:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:11:58.434127 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-7d10a553-3718-41dd-a47c-b87a9527f520 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:11:58.465782 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-7d10a553-3718-41dd-a47c-b87a9527f520 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036188 Aug 31 12:11:58.466775 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 31 12:11:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:12:16.059920 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-f96d77d4-800e-4949-96f9-480cc4303502 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:16.060943 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-f96d77d4-800e-4949-96f9-480cc4303502 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 31 12:12:16.061347 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:16.072884 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:16.507560 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1116cc78-5747-44ad-94d6-99ea43bde8b3 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:16.526582 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-1116cc78-5747-44ad-94d6-99ea43bde8b3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.458243 Aug 31 12:12:16.527540 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 31 12:12:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:12:17.621523 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-f96d77d4-800e-4949-96f9-480cc4303502 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:17.622553 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-f96d77d4-800e-4949-96f9-480cc4303502 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 12:12:17.622952 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:18.238002 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6695ac2a-18f0-4b6e-8dc4-d66ede7b1e00 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:18.246034 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-6695ac2a-18f0-4b6e-8dc4-d66ede7b1e00 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6695ac2a-18f0-4b6e-8dc4-d66ede7b1e00 admin admin] Request method failure captured: Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Accept: application/json Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Connection: keep-alive Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Content-Length: 0 Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Host: 10.222.0.27 Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.90 Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Openstack-System-Scope: None Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: User-Agent: python-novaclient Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjD1Ah83IcqqGx2W4rVvImfdxFyV8AKWym8xtPUd7CfayFRDeuyG-XRFHL0w45zC0XNpp0Wd_yRt-Nk2nnzDf5MSW7w91MTwzi2JVNLuYwQ5oTN2cdG4i8eLqqd0F-eMC2wH5RtC6vCG2zwOTDjvq9rYVIAGjsg9Mmc4Pda5egug6O7FE Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Domain-Id: None Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Domain-Name: None Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Identity-Status: Confirmed Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Is-Admin-Project: True Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Domain-Id: default Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Domain-Name: Default Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Name: admin Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Role: member,reader,admin Aug 31 12:12:18.249729 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Roles: member,reader,admin Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6117aaa4eb34295b2216e51a40eacde", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant: admin Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant-Name: admin Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User: admin Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Domain-Id: default Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Domain-Name: Default Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Id: 186838d97c1140bb9bd1a7296d1414bf Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Name: admin Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: method: > Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: exception: Flavor 42 could not be found. Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: action_args: {'id': '42'} Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:12:18.251570 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:18.252441 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.254655 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6695ac2a-18f0-4b6e-8dc4-d66ede7b1e00 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:12:18.257406 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-6695ac2a-18f0-4b6e-8dc4-d66ede7b1e00 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.495426 Aug 31 12:12:18.257406 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 31 12:12:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 497 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:18.268120 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-a0822930-007d-4e6f-9488-7b9bbb81b4a5 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:18.272559 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:18.302524 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-a0822930-007d-4e6f-9488-7b9bbb81b4a5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038462 Aug 31 12:12:18.303407 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 31 12:12:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:12:18.316689 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-b1b38d5c-2325-4ad2-8450-fa061610b5ad admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:18.350815 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-b1b38d5c-2325-4ad2-8450-fa061610b5ad admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037477 Aug 31 12:12:18.351610 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 31 12:12:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:12:18.362714 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-acbb7dee-bf06-4518-8fdf-bc1b03878b40 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:18.370119 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.wsgi [None req-acbb7dee-bf06-4518-8fdf-bc1b03878b40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-acbb7dee-bf06-4518-8fdf-bc1b03878b40 admin admin] Request method failure captured: Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Accept: application/json Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Accept-Encoding: gzip, deflate Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Connection: keep-alive Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Content-Length: 0 Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Host: 10.222.0.27 Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Openstack-Api-Version: compute 2.90 Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Openstack-System-Scope: None Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: User-Agent: python-novaclient Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Auth-Token: gAAAAABjD1Ah83IcqqGx2W4rVvImfdxFyV8AKWym8xtPUd7CfayFRDeuyG-XRFHL0w45zC0XNpp0Wd_yRt-Nk2nnzDf5MSW7w91MTwzi2JVNLuYwQ5oTN2cdG4i8eLqqd0F-eMC2wH5RtC6vCG2zwOTDjvq9rYVIAGjsg9Mmc4Pda5egug6O7FE Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Domain-Id: None Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Domain-Name: None Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Identity-Status: Confirmed Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Is-Admin-Project: True Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Domain-Id: default Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Domain-Name: Default Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Name: admin Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Role: member,reader,admin Aug 31 12:12:18.373851 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Roles: member,reader,admin Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6117aaa4eb34295b2216e51a40eacde", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant: admin Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant-Name: admin Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User: admin Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Domain-Id: default Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Domain-Name: Default Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Id: 186838d97c1140bb9bd1a7296d1414bf Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Name: admin Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: method: > Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: exception: Flavor 42 could not be found. Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: action_args: {'id': '42'} Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:12:18.376226 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:18.377482 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:18.379610 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-acbb7dee-bf06-4518-8fdf-bc1b03878b40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:12:18.381828 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-acbb7dee-bf06-4518-8fdf-bc1b03878b40 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016951 Aug 31 12:12:18.381828 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 31 12:12:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:19.509194 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-b1b38d5c-2325-4ad2-8450-fa061610b5ad admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:19.510208 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-b1b38d5c-2325-4ad2-8450-fa061610b5ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 31 12:12:19.510625 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:12:20.097570 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-e5a4d09c-8bef-4f2d-866f-1b2d86cb2537 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:20.104512 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.wsgi [None req-e5a4d09c-8bef-4f2d-866f-1b2d86cb2537 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-e5a4d09c-8bef-4f2d-866f-1b2d86cb2537 admin admin] Request method failure captured: Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Accept: application/json Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Accept-Encoding: gzip, deflate Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Connection: keep-alive Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Content-Length: 0 Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Host: 10.222.0.27 Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Openstack-Api-Version: compute 2.90 Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Openstack-System-Scope: None Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: User-Agent: python-novaclient Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Auth-Token: gAAAAABjD1Ajm8ukdmhcIL6AabzBMPLHNn_bprawU9RTTtwztHByrfHYnaniWLT8A4FRiN6A5Mb_dvRuGTCBcU8eZ4BSrP3nWnG-XgDHvzvftrJUNlNymJWVwPFDpy0oq40rGEHrHMF2RKRL-E0lpDQJ1BGJBzEYulpsqcYK70_tHVFZbE7mxpc Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Domain-Id: None Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Domain-Name: None Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Identity-Status: Confirmed Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Is-Admin-Project: True Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Domain-Id: default Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Domain-Name: Default Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Name: admin Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Role: member,reader,admin Aug 31 12:12:20.106044 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Roles: member,reader,admin Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6117aaa4eb34295b2216e51a40eacde", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant: admin Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant-Name: admin Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User: admin Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Domain-Id: default Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Domain-Name: Default Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Id: 186838d97c1140bb9bd1a7296d1414bf Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Name: admin Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: method: > Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: exception: Flavor 84 could not be found. Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: action_args: {'id': '84'} Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:12:20.108691 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:20.110637 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.113061 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-e5a4d09c-8bef-4f2d-866f-1b2d86cb2537 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:12:20.115664 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-e5a4d09c-8bef-4f2d-866f-1b2d86cb2537 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.457580 Aug 31 12:12:20.115664 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 31 12:12:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 459 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:20.121013 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-116d2fc6-30dc-4280-a9cb-91c459c8d4a8 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:20.137575 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-116d2fc6-30dc-4280-a9cb-91c459c8d4a8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020924 Aug 31 12:12:20.138145 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 31 12:12:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:12:20.148562 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-12e0222c-b459-4c40-a912-db7e64d518fd admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:20.164898 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-12e0222c-b459-4c40-a912-db7e64d518fd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019751 Aug 31 12:12:20.165529 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 31 12:12:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:12:20.176081 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-45e1f765-c2da-4f0c-a036-a092570d892f admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:20.182661 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-45e1f765-c2da-4f0c-a036-a092570d892f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-45e1f765-c2da-4f0c-a036-a092570d892f admin admin] Request method failure captured: Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Accept: application/json Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Connection: keep-alive Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Content-Length: 0 Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Host: 10.222.0.27 Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.90 Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Openstack-System-Scope: None Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: User-Agent: python-novaclient Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjD1Ajm8ukdmhcIL6AabzBMPLHNn_bprawU9RTTtwztHByrfHYnaniWLT8A4FRiN6A5Mb_dvRuGTCBcU8eZ4BSrP3nWnG-XgDHvzvftrJUNlNymJWVwPFDpy0oq40rGEHrHMF2RKRL-E0lpDQJ1BGJBzEYulpsqcYK70_tHVFZbE7mxpc Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Domain-Id: None Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Domain-Name: None Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Identity-Status: Confirmed Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Is-Admin-Project: True Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Domain-Id: default Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Domain-Name: Default Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Name: admin Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Role: member,reader,admin Aug 31 12:12:20.184235 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Roles: member,reader,admin Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6117aaa4eb34295b2216e51a40eacde", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant: admin Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant-Name: admin Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User: admin Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Domain-Id: default Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Domain-Name: Default Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Id: 186838d97c1140bb9bd1a7296d1414bf Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Name: admin Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: method: > Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: exception: Flavor 84 could not be found. Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: action_args: {'id': '84'} Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:12:20.185834 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:20.186713 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:20.188184 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-45e1f765-c2da-4f0c-a036-a092570d892f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:12:20.189436 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-45e1f765-c2da-4f0c-a036-a092570d892f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013359 Aug 31 12:12:20.189436 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 31 12:12:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:21.186513 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-12e0222c-b459-4c40-a912-db7e64d518fd admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:21.187578 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-12e0222c-b459-4c40-a912-db7e64d518fd admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 31 12:12:21.187975 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:21.819568 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-b1449740-c01f-4590-adb0-fcb1b8cab979 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:21.826622 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-b1449740-c01f-4590-adb0-fcb1b8cab979 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-b1449740-c01f-4590-adb0-fcb1b8cab979 admin admin] Request method failure captured: Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Accept: application/json Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Connection: keep-alive Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Content-Length: 0 Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Host: 10.222.0.27 Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.90 Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Openstack-System-Scope: None Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: User-Agent: python-novaclient Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjD1AlODR657lgqiFEBZeCeFW_J8c6Bp0HxrVKVbp6vAWgBk2gXuQWBoStwTiCXrxPgTbEBMfQ1WGi823auFPeGzQyEe6UpNgHO57XUIfeZaZvWSk2B1fBHSTJgDNwrkWb0p1n8c8yaX8j7BtIie0DAXy-Vw82_xMuaxzX3r2xLq9HsHA Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Domain-Id: None Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Domain-Name: None Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Identity-Status: Confirmed Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Is-Admin-Project: True Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Domain-Id: default Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Domain-Name: Default Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Project-Name: admin Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Role: member,reader,admin Aug 31 12:12:21.828216 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Roles: member,reader,admin Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6117aaa4eb34295b2216e51a40eacde", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant: admin Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-Tenant-Name: admin Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User: admin Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Domain-Id: default Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Domain-Name: Default Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Id: 186838d97c1140bb9bd1a7296d1414bf Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: X-User-Name: admin Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: method: > Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: exception: Flavor 451 could not be found. Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: action_args: {'id': '451'} Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:12:21.830323 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:21.831546 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.833316 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-b1449740-c01f-4590-adb0-fcb1b8cab979 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:12:21.835114 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-b1449740-c01f-4590-adb0-fcb1b8cab979 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.500412 Aug 31 12:12:21.835114 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 31 12:12:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:21.840887 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-fe4e4f39-50ea-4837-b22f-7be79661e93a admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:21.858084 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-fe4e4f39-50ea-4837-b22f-7be79661e93a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020909 Aug 31 12:12:21.858694 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 31 12:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:12:21.870048 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:21.886418 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020468 Aug 31 12:12:21.886973 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 31 12:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:12:21.896917 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-8ec80627-f086-48e8-89a0-fda9ceb13e49 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:21.902915 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.wsgi [None req-8ec80627-f086-48e8-89a0-fda9ceb13e49 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-8ec80627-f086-48e8-89a0-fda9ceb13e49 admin admin] Request method failure captured: Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Accept: application/json Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Accept-Encoding: gzip, deflate Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Connection: keep-alive Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Content-Length: 0 Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Host: 10.222.0.27 Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Openstack-Api-Version: compute 2.90 Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Openstack-System-Scope: None Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: User-Agent: python-novaclient Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Auth-Token: gAAAAABjD1AlODR657lgqiFEBZeCeFW_J8c6Bp0HxrVKVbp6vAWgBk2gXuQWBoStwTiCXrxPgTbEBMfQ1WGi823auFPeGzQyEe6UpNgHO57XUIfeZaZvWSk2B1fBHSTJgDNwrkWb0p1n8c8yaX8j7BtIie0DAXy-Vw82_xMuaxzX3r2xLq9HsHA Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Domain-Id: None Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Domain-Name: None Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Identity-Status: Confirmed Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Is-Admin-Project: True Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Domain-Id: default Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Domain-Name: Default Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Project-Name: admin Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Role: member,reader,admin Aug 31 12:12:21.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Roles: member,reader,admin Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6117aaa4eb34295b2216e51a40eacde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6117aaa4eb34295b2216e51a40eacde", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant: admin Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant-Id: b6117aaa4eb34295b2216e51a40eacde Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-Tenant-Name: admin Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User: admin Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Domain-Id: default Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Domain-Name: Default Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Id: 186838d97c1140bb9bd1a7296d1414bf Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: X-User-Name: admin Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: method: > Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: exception: Flavor 451 could not be found. Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: action_args: {'id': '451'} Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:12:21.905977 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:21.907097 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: ERROR nova.api.openstack.wsgi Aug 31 12:12:21.908479 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-8ec80627-f086-48e8-89a0-fda9ceb13e49 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:12:21.909717 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-8ec80627-f086-48e8-89a0-fda9ceb13e49 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012949 Aug 31 12:12:21.909717 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 31 12:12:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:22.985764 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:22.986778 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 12:12:22.987191 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:23.584375 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-1f497321-a9eb-44ab-8740-fbf77a08dd5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:12:23.605325 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-1f497321-a9eb-44ab-8740-fbf77a08dd5b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.477291 Aug 31 12:12:23.605888 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 31 12:12:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:12:24.762728 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:24.763800 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 31 12:12:24.764190 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:25.421313 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-d822c8ff-d809-4971-b663-f32901203cb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:12:25.442126 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-d822c8ff-d809-4971-b663-f32901203cb7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.506765 Aug 31 12:12:25.442729 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 31 12:12:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:12:26.521301 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:26.522342 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 31 12:12:26.522911 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:27.145772 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-e8b4b4b2-6398-46cd-8689-4cbfc3130bd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:12:27.169033 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-e8b4b4b2-6398-46cd-8689-4cbfc3130bd6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.487048 Aug 31 12:12:27.169431 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 31 12:12:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:12:28.281010 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:28.282060 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 31 12:12:28.282452 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:12:28.943389 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-3f16a799-6ca2-4c8b-9aee-523ae0693a1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:12:28.967566 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-3f16a799-6ca2-4c8b-9aee-523ae0693a1e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.543110 Aug 31 12:12:28.968140 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 31 12:12:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:12:30.171645 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:30.172664 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 31 12:12:30.173061 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:12:30.803491 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-699ba4bd-e1d2-42aa-91cc-8a1b3caa0cf2 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:12:30.824666 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-699ba4bd-e1d2-42aa-91cc-8a1b3caa0cf2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.509041 Aug 31 12:12:30.825182 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Aug 31 12:12:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:13:25.958755 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:13:25.959792 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-ccdca91b-19fe-402e-8e18-2a09f1d1eb9e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 31 12:13:25.960189 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 31 12:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:13:25.971818 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:13:26.407545 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-d8224e86-191a-4ed5-ac8a-c7d86e1c1519 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:13:26.428951 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-d8224e86-191a-4ed5-ac8a-c7d86e1c1519 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.462176 Aug 31 12:13:26.429525 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 31 12:13:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:13:26.450866 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=14 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:13:26.455006 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1ac8aec9-0125-4f8e-bbff-84e72de2c29e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:13:26.463374 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-1ac8aec9-0125-4f8e-bbff-84e72de2c29e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013891 Aug 31 12:13:26.463943 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Aug 31 12:13:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:13:26.476605 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-a2d3a81f-75bb-4344-9bc3-02e7c7b25ab2 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:13:26.486524 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-a2d3a81f-75bb-4344-9bc3-02e7c7b25ab2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013684 Aug 31 12:13:26.487014 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Aug 31 12:13:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:13:26.499434 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:13:26.507347 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011884 Aug 31 12:13:26.507901 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Aug 31 12:13:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:13:26.521205 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-ef98f57a-ba33-4f0d-8536-12d8b2373ebe admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:13:26.530378 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-ef98f57a-ba33-4f0d-8536-12d8b2373ebe admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013468 Aug 31 12:13:26.531331 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Aug 31 12:13:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:16:29.655408 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:29.656436 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 31 12:16:29.656852 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:16:29.795441 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_api:SELECT=6 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.967375 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:29.971007 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:29.971555 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:29.971981 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:29.972685 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:29.973131 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:29.973544 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:30.007908 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-4e37b262-652e-4b3d-a141-d5318acdc8a2 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.213812 Aug 31 12:16:30.008487 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 31 12:16:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:16:30.846891 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:30.847969 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 31 12:16:30.848379 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:16:31.049437 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:31.054739 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:31.055266 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:31.056481 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:31.057347 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:31.058157 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:31.058583 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:31.084746 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-09f176dc-f124-426c-ac13-abf34a9ff9a9 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.096528 Aug 31 12:16:31.085362 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 31 12:16:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:16:42.425453 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:42.426856 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 31 12:16:42.426993 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:16:42.573592 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_cell0:SELECT=4 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.574333 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_cell1:SELECT=4 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.575022 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG dbcounter [-] [105506] Writing DB stats nova_api:SELECT=8 {{(pid=105506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.629100 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:42.633021 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:42.633432 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:42.633963 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:42.635180 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:42.635643 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:42.636058 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:42.661341 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-c2b21cb3-bc74-48ab-8aea-d710c41ca15f admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092574 Aug 31 12:16:42.662216 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 31 12:16:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:16:43.528650 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:43.530124 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-51c5ebe1-d059-4119-81ef-a27d6b19ad2d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 Aug 31 12:16:43.530572 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 31 12:16:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:16:43.731647 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG nova.api.openstack.wsgi [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Calling method '>' {{(pid=105506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:16:43.735533 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:43.735993 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:43.736424 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:43.737163 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:16:43.737581 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:16:43.737997 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: DEBUG oslo_concurrency.lockutils [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:16:43.762239 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: INFO nova.api.openstack.requestlog [None req-5320e054-bf53-451c-8dde-00389f3a12ee admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088111 Aug 31 12:16:43.762835 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: [pid: 105506|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 31 12:16:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:17:43.979875 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: Wed Aug 31 12:17:43 2022 - graceful shutdown triggered... Aug 31 12:17:43.980014 dv-cinder-855359-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 12:17:43.980980 dv-cinder-855359-1-iscsi devstack@n-api.service[105506]: Gracefully killing worker 1 (pid: 105506)... Aug 31 12:17:43.981366 dv-cinder-855359-1-iscsi devstack@n-api.service[105507]: Gracefully killing worker 2 (pid: 105507)... Aug 31 12:17:44.982155 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: worker 1 buried after 1 seconds Aug 31 12:17:44.982155 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: worker 2 buried after 1 seconds Aug 31 12:17:44.982155 dv-cinder-855359-1-iscsi devstack@n-api.service[105505]: goodbye to uWSGI. Aug 31 12:17:44.983819 dv-cinder-855359-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 12:17:44.984384 dv-cinder-855359-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 12:17:44.987314 dv-cinder-855359-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 12:17:44.997289 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:17:44 2022] *** Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: nodename: dv-cinder-855359-1-iscsi Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: machine: x86_64 Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: clock source: unix Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: pcre jit disabled Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: detected number of CPU cores: 4 Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: current working directory: / Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: your processes number limit is 47680 Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: your memory page size is 4096 bytes Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: detected max file descriptor number: 2048 Aug 31 12:17:44.999657 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: lock engine: pthread robust mutexes Aug 31 12:17:45.000572 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: thunder lock: enabled Aug 31 12:17:45.000572 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 12:17:45.000572 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:17:45.039904 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: Python main interpreter initialized at 0x5568a729c9c0 Aug 31 12:17:45.039904 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: python threads support enabled Aug 31 12:17:45.039904 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: your server socket listen backlog is limited to 100 connections Aug 31 12:17:45.039904 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:17:45.040348 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:17:45.040348 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: *** Operational MODE: preforking *** Aug 31 12:17:45.040663 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:17:45.040663 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: spawned uWSGI master process (pid: 120555) Aug 31 12:17:45.044077 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: spawned uWSGI worker 1 (pid: 120572, cores: 1) Aug 31 12:17:45.044077 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: spawned uWSGI worker 2 (pid: 120573, cores: 1) Aug 31 12:17:45.044077 dv-cinder-855359-1-iscsi devstack@n-api.service[120555]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:17:45.040883 dv-cinder-855359-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 12:17:45.709073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:17:45.729462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 12:17:46.863828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:17:46.863828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: from cryptography.utils import int_from_bytes Aug 31 12:17:46.864526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:17:46.864526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: from cryptography.utils import int_from_bytes Aug 31 12:17:46.908297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:17:46.908297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: from cryptography.utils import int_from_bytes Aug 31 12:17:46.908896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:17:46.908896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: from cryptography.utils import int_from_bytes Aug 31 12:17:49.335582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:17:49.336192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:17:49.336554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:17:49.336772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:17:49.337011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:17:49.337381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.337712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.338038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.338390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.338878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.339190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.339543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.339873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.340187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.340445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.340759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.341083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-1-iscsi {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.341407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.341734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.342026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.342353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.342662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.342962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.343286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.343793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.345555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.345880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.346308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.346547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.346875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.347277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.347668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.347997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.348325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.348640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.349064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-1-iscsi {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.349388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.349904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.350127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.350491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.350827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.351128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.351481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.351790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.352084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.352440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.352758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.353061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.353373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.353671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.353992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.354297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.354608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.354921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.355267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.355507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.355798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.356138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.356451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.356766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.357013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.357250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.357572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.357887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.358197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.358501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.358806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.359110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.359436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.359747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.360076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.360379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.360690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.361012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.361338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.361644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.361956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.362367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.362614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.362920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.363299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.363606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.363915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.364230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.364550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.364857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.365261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.365728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.366054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.366393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.366727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.366965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.367209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.367574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.367890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.368196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.368502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.368803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.369101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.369409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.369712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.370084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.370332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.371572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.371572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.371572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.371572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.373322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.373322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.373322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.373322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.373322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.373322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.374568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.374568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.374568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.374568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.376545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.376545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.376545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.376545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.376545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.376545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.377770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.377770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.377770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.377770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.377770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.380558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.382506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.385479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.395104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.396216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.397571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.398671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.398671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.398671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.398671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.399402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.399402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.399709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.399870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.400706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.400706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.401029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.401205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.401740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.401740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.402037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.402402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.402568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.402865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.403166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.403667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.403858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.404565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.404565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.404893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.405043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:17:49.405563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.405723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:17:49.405867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.405867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.406176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:17:49.406326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.406514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:17:49.406667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.406819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:17:49.406963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.407123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.407371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.407557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.407706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.407849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.407991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.408152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.408297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.408297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.408602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.408755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.408905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.409055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.409290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.409443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.409585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.409733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.409883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.410023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.410590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.410762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.410919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.411068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.411210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855359-1-iscsi {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.411438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.411956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.412169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.412321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.412501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.412833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.413016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.413168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.413464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.413677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.413883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.414099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.414275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.414275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.414566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.414707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.414707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.414975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.415152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.415362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.415547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.415703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.415854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.416062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.416253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.416253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.416615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.416615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.416902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.416902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.417191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.417390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.417537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.417690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.417850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.418012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.418165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.418317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.418460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.418602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.418755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855359-1-iscsi {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.418897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.419038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.419178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.419344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.419506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.419673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.419815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.419963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.420123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.420265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.420433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.421017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.421176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.421321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.421471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.421614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.422199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.422357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.422519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.422519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.423039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.423203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.423433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.423726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.423883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.424034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.424176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.424176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.424459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.424614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.424758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.424911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.425061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.425210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.425365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.425515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.425664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.425808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.425955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.426102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.426253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.426402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.426549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.426709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.426860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.427010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.427166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.427343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.427544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.427818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.427978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.428130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.428901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.429058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.429544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.430304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.430468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.430623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.430875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.431045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.431399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.431560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.431711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.431882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.432383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.432534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.432684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.432826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.433195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.433346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.433497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.433497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.433898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.434046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.434208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.434360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.434604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.434753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.434902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.435052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.435272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.435434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.435577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.435718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.435718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.435985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.436135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.436286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.436428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.436568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.436784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.436956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.437110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.437306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.437507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.437663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.437820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.437978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.438121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.438268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.438418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.438568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.438709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.438871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.439020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.439169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.439411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.439557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.439741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.439894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.440044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.440193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.440341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.440490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.440631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.440973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.441132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.441399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.441560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.441715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.441872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.442014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.442511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.442664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.442806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.442949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.443355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.443516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.443669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.443811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.444098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.444248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.444417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.444561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.444710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.444852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.444993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.445134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.445287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.445429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.445577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.445758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.445903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.446060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.446220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.446371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.446520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.446662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.446805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.446957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.447100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.447281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.447442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.447646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.447801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.447958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.448109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.448262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.448418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.448562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.448711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.448854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.448854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.449129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.449129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.449129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.450096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.450096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.450379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.450538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.450697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.450839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.451108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.451280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.451440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.451592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.451742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.451892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.452043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.452698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.452857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.453008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.453152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.453530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.453679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.453831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.453973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.454251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.454409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.454560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.454712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.454855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.454997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.455139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.455311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.455477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.455630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.455773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.455913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.456054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.456204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.456346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.456496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.456645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.456787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.456930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.457071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.457219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.457381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.457524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.457720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.457869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.458011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.458174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:17:49.458318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.458607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.458774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.459955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.460992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.461254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.461412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.461567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.461717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.461865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.462021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.462171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.462807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.462967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.463116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.463283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.463657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.463816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.463973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.464130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.464414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.464569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.464734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.464883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.465986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.466134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.466288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.466461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.466618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.466777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.466925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.467072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.467297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.467297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.467614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.467832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.467994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.468158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.468315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.468497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.468647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.468647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.468944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.469092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.469253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.470985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.471153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.471431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.471586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.471745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.471983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.472142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.472290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.472437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.473133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.473301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.473461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.473854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.474017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.474187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.474344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.474688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.474845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.475003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.475168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.475400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.475551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.475712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.475869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.476938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.477085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.477241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.477396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.477566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.477718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.477718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.478074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.478233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.478381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.478554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.478554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.478844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.479773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.480967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.481124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.481280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.481448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.481448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.481868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.482018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.482175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.482323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.482323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.482624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.483410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.483410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.483742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.484125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.484279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.484428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.484428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.484874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.485796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.486352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.486515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.486515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.486813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.486971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.487145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.487331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.487331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.487665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.487814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.487814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.488185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.488336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.488494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.488645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.488645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.488929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.489834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.490275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.490436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.490436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.490729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.490879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.491027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.491190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.491190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.491560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.491730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.492938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.493664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.493833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.494011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.494011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.494553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.494712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.498298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.501926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.501926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.502285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.502463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.502463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.502768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.502921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.503071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.503331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.503331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.503719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.503875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.504035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.504192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.504394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.504549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.504549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.504852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.505545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.505725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.505916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.505916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.506345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.506475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.506475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.506966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.507299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.507299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.507666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.507826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.507989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.508242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.508242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.508504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.508747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.508747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.509175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.509333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.509734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.509829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.509829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.509989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.510591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.511141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.513869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.514673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.515945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.516857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.517991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.518075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.518160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.518160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.518160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.519933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.520875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.521875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.523918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.524980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.525163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.525262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.525672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.525893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.526042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.526344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.526517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.526740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.527004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.527159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.527414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.527672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.527785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.528032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.529457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.529596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.529686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.529855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.530788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.531792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.532090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.532199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.532399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.532606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.532728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.533001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.533110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.533331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.533601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.533707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.533960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.534127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.534272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.534582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.534813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.534908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.535391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.535685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.535874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.535974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.536261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.537596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.537709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.537786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.537786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.537926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.538186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.538527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.538661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.538808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.538890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.539180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.539347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.539549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.539834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.539915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.540143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.540339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.540433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.540758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.540838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.541068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.541322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.541411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.541681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.541809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.541989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.542330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.542670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.542853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.543014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.543457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.543553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.543712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.544048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.544144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.544434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.544574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.544806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.544947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.545136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.545446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.545551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.545813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.545992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.546175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.546578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.546678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.546878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.547027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.547186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.547570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.547756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.547883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.548210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.548312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.548560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.548741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.548902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.549371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.549515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.550091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.550205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.550561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.550913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.551254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.551574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.551879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.552197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.552499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.552868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.552985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.553176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.553568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.553748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.553895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.554059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.554490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.554797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.554924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.555083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.555383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.555493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.555709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.555920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.556102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.556327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.556647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.556772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.556962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.557273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.557373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.557648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.557892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.558003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.558430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.558553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.558849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.558962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.559172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.559462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.559578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.559862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.560030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.560195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.560558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.560660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.560757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.561032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.561140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.561371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.561565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.561677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.561972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.562076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.562280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.562584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.562681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.562888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.563089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.563391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.563593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.563767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.563925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.564088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.564238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.564484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.564645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.564818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.565065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.565237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.565389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.565545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.565694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.566013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.566191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.566332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.566687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.566914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.567111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.567320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.567435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.567660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.567774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.567936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.568288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.568478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.568663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.568819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.568989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.569239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.569389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.569561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.569875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.570044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.570300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.570558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.570719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.570920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.571074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.571213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.571421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.571639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.571739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.572003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.572206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.572322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.572631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.572773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.573833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.573945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.574980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.575456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.575621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.575923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.576235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.576548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.576861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.577340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.577681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.578090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.578256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.578400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.578549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.578689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.578836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.579034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.579174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.579587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.579774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.579927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.580083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.580245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.580398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.580566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.580742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.580898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.581939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.582996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.583179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.583450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.583587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.583765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.584013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.584217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.584386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.584532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.584734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.584875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.585040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.585139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.585396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.585717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.585830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.585969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.586134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.586279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.586458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.586571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.586784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.586885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.587100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.587193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.587451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.587546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.587765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.587892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.588998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.589090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.589334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.589437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.589649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.589760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.589958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.590965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.591170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.591292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.591522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.591641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.591831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.591957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.592131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.592232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.592445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.592540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.592748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.592839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.593949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.594988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.595203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.595441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.595595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.595707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.595903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.596921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.597119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.597219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.597431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.597531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.597746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.597851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.598939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.599033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.599257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.599360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.599672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.599787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.600119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.600279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.600431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.600593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.600742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.600837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.601046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.601140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.601288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:17:49.601451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.601905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.602066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.602371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.602672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.603015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.603361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.603720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.604022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.604335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.604653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.604962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.605288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.605583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.605886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.606194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.606501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.606809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.607110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.607432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.607753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.608062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.608381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.608691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.609007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.609327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.609628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.610049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.610236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.611274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.611274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.611274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.611591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.611777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.612069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.612378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.616783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.616783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.616783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.616783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.616783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.617209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.617299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.617616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.617929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.618240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.618553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.618969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.619163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.619600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.619910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.620219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.620591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.620897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.621199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.621515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.621830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.622120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.622421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.622720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.623059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.623365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.623686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.624094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.624399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.624699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.625107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.625411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.625716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.626070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.626354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.626699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.627082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.627295 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.627604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.627923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.628241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.628701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.629290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.629290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.629628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.630067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.630246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.630552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.631346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.631720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.632092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.632419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.632746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.633049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.633353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.633659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.633961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.634259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.634577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.634878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.635185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.635516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.635821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.636121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.636425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.636824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.637040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.637357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.637672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.637987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.638301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.638603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.638921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.639281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.639549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.639852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.640152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.640491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.640793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.641110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.641455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.641761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.642069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.642396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.642715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.643027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.643362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.643686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.643986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.644293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.644654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.644957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.645256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.645555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.645860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.646157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.646613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.646918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.647326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.647565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.647887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.648194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.648497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.648804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.649108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.649440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.649740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.650076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.650376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.650726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.651013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.651347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.651661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.651973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.652286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.652600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.652912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.653216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.653529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.653838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.654147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.654749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.655097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.655418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.655731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.656064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.656349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.656663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.656986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.657278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.657586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.657889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.658216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.658533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.658855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.659186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.659525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.659837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.660146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.661559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.661559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.661559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.661559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.661882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.662030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.662384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.662640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.663085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.663432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.663745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.664054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.664357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.664668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.664980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.665301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.665631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.665952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.666265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.666576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.666890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.667463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.667671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Registered counter for database nova_api Aug 31 12:17:49.667782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.668093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.668423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.668737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.669054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.669367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.669693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.670005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.670294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.670604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.670905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.671209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.671542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.671848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.672151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.672464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.672768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.673395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.673739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.674052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.674372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.674693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.675004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.675339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.675659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.675962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.676262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.676575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.676885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.677184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.677485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.677918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.678400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.678711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.679012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.679667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.679993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.680297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.680602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.680907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.681215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.681516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.681817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.682117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.682415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.682725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.683024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.683354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.683657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.683970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.684272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.684581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.684933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.685257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.685560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.685860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.686179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.686488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.686804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.687117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.687457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.687832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.688121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.689539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.689873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.690201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.690553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.691030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.691785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.692077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.692408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.692843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.693047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.693620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.694061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.694293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.694678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.694903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.695328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.695546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.695898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.696143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.696450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.696756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.697060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.697368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.697693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.697985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.698329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.698650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.698963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.699857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:49.700013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.700013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.700013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.700466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.700466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.700802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.701167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.701412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.701705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.702011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.702436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.702748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.703060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.703401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.703708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.704027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.704342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.704650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.704967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.705275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.705668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.705931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.706255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.706576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.706879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.707181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.707510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.707903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.708124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.708490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.708797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.710906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.711357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.711547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.711846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.712137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.712432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.712730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.713032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.713330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.713628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.713925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.714225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.714521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.714852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.715181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.715524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.715869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.716147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.716464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.716796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.717082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.717398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.717715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.718029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.718340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.718645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.718954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.719357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.719583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.719888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.720195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.720517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.720834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.721135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.721584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.721758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.722051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.722386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.722657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.722978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.723414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.723657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.723884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.724194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.724658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.724978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.725284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.725590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.725960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.726246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.726498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.726818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.727120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.727462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.727785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.728145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.728441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.728765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.729089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.729395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.729703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.730007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:17:49.730245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:17:49.756404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.context [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d768c00b-9249-4c6a-9bd1-79d66da87324(cell1) {{(pid=120572) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:17:49.760728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:17:49.761219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:17:49.762845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:17:49.763609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:17:49.764058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:17:49.766099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:17:49.768222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Registered counter for database nova_cell0 Aug 31 12:17:49.773117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Registered counter for database nova_cell1 Aug 31 12:17:49.781630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.785954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.787716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:49.793019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Registered counter for database nova_api Aug 31 12:17:49.813776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.821192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:49.892143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.context [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d768c00b-9249-4c6a-9bd1-79d66da87324(cell1) {{(pid=120573) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 12:17:49.898990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:17:49.899588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:17:49.901274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:17:49.902071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:17:49.902531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:17:49.905597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:17:49.907532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Registered counter for database nova_cell0 Aug 31 12:17:49.911705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Registered counter for database nova_cell1 Aug 31 12:17:49.919313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.921725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.927528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:49.929464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:49.936081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:49.946447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Registered counter for database nova_cell0 Aug 31 12:17:49.953358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:49.957996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:50.076033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Registered counter for database nova_cell0 Aug 31 12:17:50.084627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:17:50.089720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:17:50.282069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:17:50.289583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:17:50.408052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:17:50.415909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:17:50.639794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:17:50.646223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-7e19f316-4963-43a8-b4db-66de9fd03d21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:17:50.652203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568a729c9c0 pid: 120572 (default app) Aug 31 12:17:50.763474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 12:17:50.769605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-ddd86786-1584-4a45-af8a-7af87a389e63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 12:17:50.775843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568a729c9c0 pid: 120573 (default app) Aug 31 12:18:26.952863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:26.953842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:26.954688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:26.955763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:28.138291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7ad0056-f6eb-461f-82b9-d1d0155ff098 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Action: 'create', calling method: .version_select at 0x7fe855df2ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2066212534"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:30.600777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7ad0056-f6eb-461f-82b9-d1d0155ff098 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.662224 Aug 31 12:18:30.601396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Aug 31 12:18:26 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3664 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 12:18:30.619405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:30.621151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:30.622172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:30.624644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:31.107138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12df4bb5-a2ee-493b-a343-8021ec0292a6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855deac10>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:32.633869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12df4bb5-a2ee-493b-a343-8021ec0292a6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 200 len: 346 microversion: 2.1 time: 2.018485 Aug 31 12:18:32.643163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:18:30 2022] GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 346 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:32.658119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc6d7ff6-0dd2-4846-8c11-3c5a86a326a0 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Action: 'create', calling method: .version_select at 0x7fe855c75ca0>, body: {"snapshot": {"volume_id": "f51b4e0d-c0b1-4258-bd8b-4b7622d31862", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-142216206"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:33.223383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc6d7ff6-0dd2-4846-8c11-3c5a86a326a0 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.575008 Aug 31 12:18:33.230164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Aug 31 12:18:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:33.238586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a6afb6b0-b6f3-4c1c-96e6-95af240665ec tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855cb2ca0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:33.324458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a6afb6b0-b6f3-4c1c-96e6-95af240665ec tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 200 len: 286 microversion: 2.1 time: 0.092559 Aug 31 12:18:33.331453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:33 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:33.339400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-153465ca-eb6d-4845-8fbc-5fb8b319dc82 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c8de50>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:33.557329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-153465ca-eb6d-4845-8fbc-5fb8b319dc82 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.224581 Aug 31 12:18:33.559122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Aug 31 12:18:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:33.571804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb705e78-1efc-4e07-baa4-2fabac54e34d tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c6e430>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:33.706450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb705e78-1efc-4e07-baa4-2fabac54e34d tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 200 len: 286 microversion: 2.1 time: 0.139087 Aug 31 12:18:33.707718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:33 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:34.727186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48844b6f-738a-48c4-b16e-edd7aed9b55a tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c8dca0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:34.913120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48844b6f-738a-48c4-b16e-edd7aed9b55a tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 200 len: 286 microversion: 2.1 time: 0.192051 Aug 31 12:18:34.914226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:34 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:35.926259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-907d7fc2-106f-4c7d-a876-ff0a04d09638 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c6eaf0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:35.985196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-907d7fc2-106f-4c7d-a876-ff0a04d09638 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 200 len: 286 microversion: 2.1 time: 0.063256 Aug 31 12:18:35.991530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:35 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:36.110938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ec922f2-6dcf-416c-bc43-df3bbfef5178 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'create', calling method: .version_select at 0x7fe855c8d5e0>, body: {"keypair": {"name": "tempest-keypair-1504599038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiUx1BENBglLhkrhWCmerr1UW6rC7rl6d+mPwTLEbA7SDt3IXtD/NVXxo2fu3d6gwlNs5J3pqjE1svCHGxI7FIIf1UWSkH/D8QQP7nUl+unbq8BfqEvJnLjE0JsAiqMzQ=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:36.161489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-4ec922f2-6dcf-416c-bc43-df3bbfef5178 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for project f16c9f15d25f47a8a986290c237084d1. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:36.167961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-4ec922f2-6dcf-416c-bc43-df3bbfef5178 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for user 09b76f14426c4241aa49812f06f35cd1 and project f16c9f15d25f47a8a986290c237084d1. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:36.235587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ec922f2-6dcf-416c-bc43-df3bbfef5178 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.199636 Aug 31 12:18:36.236990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 5/9] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Aug 31 12:18:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 12:18:37.006489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a5390cb6-3bb6-4508-98b0-1d9197f19740 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855cb2ca0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:37.085368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a5390cb6-3bb6-4508-98b0-1d9197f19740 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 200 len: 287 microversion: 2.1 time: 0.088080 Aug 31 12:18:37.086365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:36 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:37.099783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-324a2561-9c94-409f-834f-62ae95756432 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855b95280>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:37.213586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-324a2561-9c94-409f-834f-62ae95756432 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 202 len: 0 microversion: 2.1 time: 0.118867 Aug 31 12:18:37.231160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3dca70d4-2eae-4919-a4fa-009acf48ea34 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c6ea60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:37.231420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Aug 31 12:18:37 2022] DELETE /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:18:37.367927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3dca70d4-2eae-4919-a4fa-009acf48ea34 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 200 len: 286 microversion: 2.1 time: 0.141210 Aug 31 12:18:37.368904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:37 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:18:38.383356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7bec413f-dd31-4884-b40f-d9b2e2c47645 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855b958b0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:38.535372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-7bec413f-dd31-4884-b40f-d9b2e2c47645 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] HTTP exception thrown: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7bec413f-dd31-4884-b40f-d9b2e2c47645 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Request method failure captured: Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea HTTP/1.1 Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GSUI_U_IKqHRa4mvEfW3_zfXNfNnIvUil7DXzrIOV2z77sHqNCB_USDk70ep5DUhaYExIQvtnsnDGVzLUc67CJrxGc1EuxjtmZu0ib6yrdfxMB_29DArxWmEJia5qsYqDRofy5ZxUK-E2CB24LrHKRDzE_md2BHA5gRK6brAwZ_Dw Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:18:38.546851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27224908eebd4b759efd8c6b24bb32a9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: fdc5e43a88d04557b81c95ce3e22e5a7 Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'b0115cf0-ba4f-4ae7-b371-5483e6afabea'} Aug 31 12:18:38.548244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. (HTTP 404) (Request-ID: req-56376586-b6ef-4418-8b51-4c98f7fa7f2f) Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.549121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:18:38.551031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 12:18:38.552574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. Aug 31 12:18:38.554071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:18:38.557660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7bec413f-dd31-4884-b40f-d9b2e2c47645 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Returning 404 to user: Snapshot b0115cf0-ba4f-4ae7-b371-5483e6afabea could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:18:38.557660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7bec413f-dd31-4884-b40f-d9b2e2c47645 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea" status: 404 len: 111 microversion: 2.1 time: 0.179822 Aug 31 12:18:38.557660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 31 12:18:38 2022] GET /compute/v2.1/os-snapshots/b0115cf0-ba4f-4ae7-b371-5483e6afabea => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:38.567184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1072754a-03e0-4c41-9c1a-ce060863fb28 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c6e3a0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:38.920089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1072754a-03e0-4c41-9c1a-ce060863fb28 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 202 len: 0 microversion: 2.1 time: 0.357261 Aug 31 12:18:38.921272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:18:38 2022] DELETE /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:18:38.934613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-591aad9b-1814-49e7-b55e-d43474248526 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855b83700>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:39.060410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-591aad9b-1814-49e7-b55e-d43474248526 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 200 len: 345 microversion: 2.1 time: 0.131604 Aug 31 12:18:39.060988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:18:38 2022] GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:40.085719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-62d46937-1570-475d-ac61-e1855fa1f2c7 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855cb2ca0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:40.271642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-62d46937-1570-475d-ac61-e1855fa1f2c7 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 200 len: 345 microversion: 2.1 time: 0.199667 Aug 31 12:18:40.272206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:18:40 2022] GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:40.431882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-166008125", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97a2865d-237f-4283-9874-26a440ac7c91"}], "security_groups": [{"name": "tempest-securitygroup--220174787"}], "key_name": "tempest-keypair-1504599038", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:40.850231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] validate_networks() for [('97a2865d-237f-4283-9874-26a440ac7c91', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:18:41.301752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b3dfc703-7e1e-4a38-9f1c-3201614698be tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c6e430>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:41.457500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b3dfc703-7e1e-4a38-9f1c-3201614698be tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 200 len: 345 microversion: 2.1 time: 0.164822 Aug 31 12:18:41.460529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 9/17] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:18:41 2022] GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:42.476297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a1943c0-5df0-495f-aa78-994f1af377e6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855c6ea60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:42.542460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-5a1943c0-5df0-495f-aa78-994f1af377e6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] HTTP exception thrown: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a1943c0-5df0-495f-aa78-994f1af377e6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Request method failure captured: Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 HTTP/1.1 Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GSUI_U_IKqHRa4mvEfW3_zfXNfNnIvUil7DXzrIOV2z77sHqNCB_USDk70ep5DUhaYExIQvtnsnDGVzLUc67CJrxGc1EuxjtmZu0ib6yrdfxMB_29DArxWmEJia5qsYqDRofy5ZxUK-E2CB24LrHKRDzE_md2BHA5gRK6brAwZ_Dw Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:18:42.548250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27224908eebd4b759efd8c6b24bb32a9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: fdc5e43a88d04557b81c95ce3e22e5a7 Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'f51b4e0d-c0b1-4258-bd8b-4b7622d31862'} Aug 31 12:18:42.549646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. (HTTP 404) (Request-ID: req-d8f2791b-f46a-4c8b-8abe-ec00a6e19800) Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:42.550404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:18:42.551855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:18:42.553525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.555160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.562118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a1943c0-5df0-495f-aa78-994f1af377e6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Returning 404 to user: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:18:42.563599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5a1943c0-5df0-495f-aa78-994f1af377e6 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 404 len: 109 microversion: 2.1 time: 0.094018 Aug 31 12:18:42.566288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 10/18] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:18:42 2022] GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:18:42.584974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b915fc7-56cb-4233-aa58-e17f6e47cbf3 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855bd84c0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:42.763480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-0b915fc7-56cb-4233-aa58-e17f6e47cbf3 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] HTTP exception thrown: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b915fc7-56cb-4233-aa58-e17f6e47cbf3 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Request method failure captured: Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 HTTP/1.1 Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GSUI_U_IKqHRa4mvEfW3_zfXNfNnIvUil7DXzrIOV2z77sHqNCB_USDk70ep5DUhaYExIQvtnsnDGVzLUc67CJrxGc1EuxjtmZu0ib6yrdfxMB_29DArxWmEJia5qsYqDRofy5ZxUK-E2CB24LrHKRDzE_md2BHA5gRK6brAwZ_Dw Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:18:42.766937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27224908eebd4b759efd8c6b24bb32a9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: fdc5e43a88d04557b81c95ce3e22e5a7 Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'f51b4e0d-c0b1-4258-bd8b-4b7622d31862'} Aug 31 12:18:42.768579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. (HTTP 404) (Request-ID: req-b63ac0ca-274f-45e6-9146-183a037a7513) Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:42.770142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:18:42.772090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:18:42.773698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:42.775831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:42.779325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b915fc7-56cb-4233-aa58-e17f6e47cbf3 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Returning 404 to user: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:18:42.779325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b915fc7-56cb-4233-aa58-e17f6e47cbf3 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 404 len: 109 microversion: 2.1 time: 0.198442 Aug 31 12:18:42.780888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:18:42 2022] DELETE /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 109 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:42.795832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0bd847a6-5c49-44f1-a3c0-c23fffe7a000 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Calling method '.version_select at 0x7fe855bd8160>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:43.068246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-0bd847a6-5c49-44f1-a3c0-c23fffe7a000 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] HTTP exception thrown: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0bd847a6-5c49-44f1-a3c0-c23fffe7a000 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Request method failure captured: Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 HTTP/1.1 Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GSUI_U_IKqHRa4mvEfW3_zfXNfNnIvUil7DXzrIOV2z77sHqNCB_USDk70ep5DUhaYExIQvtnsnDGVzLUc67CJrxGc1EuxjtmZu0ib6yrdfxMB_29DArxWmEJia5qsYqDRofy5ZxUK-E2CB24LrHKRDzE_md2BHA5gRK6brAwZ_Dw Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:18:43.072948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27224908eebd4b759efd8c6b24bb32a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27224908eebd4b759efd8c6b24bb32a9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 27224908eebd4b759efd8c6b24bb32a9 Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1801421339 Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: fdc5e43a88d04557b81c95ce3e22e5a7 Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1801421339-project Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'f51b4e0d-c0b1-4258-bd8b-4b7622d31862'} Aug 31 12:18:43.074392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. (HTTP 404) (Request-ID: req-78546b4d-fe6d-4fd9-8bd4-2e3f40e30c60) Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:43.075211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:18:43.076287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:18:43.077164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. Aug 31 12:18:43.079082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:18:43.081053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0bd847a6-5c49-44f1-a3c0-c23fffe7a000 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] Returning 404 to user: Volume f51b4e0d-c0b1-4258-bd8b-4b7622d31862 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:18:43.082893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0bd847a6-5c49-44f1-a3c0-c23fffe7a000 tempest-VolumesSnapshotsTestJSON-1801421339 tempest-VolumesSnapshotsTestJSON-1801421339-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862" status: 404 len: 109 microversion: 2.1 time: 0.295964 Aug 31 12:18:43.084277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 12/20] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:18:42 2022] GET /compute/v2.1/os-volumes/f51b4e0d-c0b1-4258-bd8b-4b7622d31862 => generated 109 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:45.019581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:18:45.020102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:18:45.021114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:18:45.021527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:18:45.021940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:18:45.043741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:45.044225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:45.044700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:45.045438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:45.053036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:45.053755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:45.089676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for project f16c9f15d25f47a8a986290c237084d1. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:45.095720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for user 09b76f14426c4241aa49812f06f35cd1 and project f16c9f15d25f47a8a986290c237084d1. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:45.123165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:18:45.133246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:18:45.264301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4efa898-6820-437c-b571-e6d8634a9fdc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.838013 Aug 31 12:18:45.265370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 9/21] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Aug 31 12:18:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 4840 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 12:18:45.277504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e97bf925-c1d4-47e2-a56c-21569fcae91b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:45.278263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e97bf925-c1d4-47e2-a56c-21569fcae91b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:45.738513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e97bf925-c1d4-47e2-a56c-21569fcae91b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:45.809475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e97bf925-c1d4-47e2-a56c-21569fcae91b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:45.833007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e97bf925-c1d4-47e2-a56c-21569fcae91b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:45.834433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e97bf925-c1d4-47e2-a56c-21569fcae91b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1281 microversion: 2.20 time: 0.561565 Aug 31 12:18:45.835039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 13/22] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1281 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:46.864518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-02f95929-4be9-49d3-af9a-a5ebd46f73d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:46.865228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-02f95929-4be9-49d3-af9a-a5ebd46f73d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:47.148160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-02f95929-4be9-49d3-af9a-a5ebd46f73d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:47.169821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-02f95929-4be9-49d3-af9a-a5ebd46f73d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:47.171776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-02f95929-4be9-49d3-af9a-a5ebd46f73d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:47.183828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-02f95929-4be9-49d3-af9a-a5ebd46f73d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1281 microversion: 2.20 time: 0.324101 Aug 31 12:18:47.188305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 14/23] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:47.190239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1228689269", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "networks": [{"uuid": "40bd0090-0c9f-472f-8b11-e12d0be08369"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:47.329749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] validate_networks() for [('40bd0090-0c9f-472f-8b11-e12d0be08369', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:18:48.212936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:48.214316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:48.225146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:48.225652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:48.228030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:48.229049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:48.229513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:48.231606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:48.644592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:48.670344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:48.678055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:48.681545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b2e1822-5443-4460-a37a-c6c8cfc3d164 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1285 microversion: 2.20 time: 0.470560 Aug 31 12:18:48.701911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 15/24] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1285 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:49.374376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:18:49.374910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:18:49.375278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:18:49.375697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:18:49.376115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:18:49.397684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:49.398231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:49.398669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:49.399525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:49.399995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:49.400419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:49.454366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Getting quotas for project 15cb4f1fac4f4d728094c3c152c1382d. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:49.469785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Getting quotas for user cace97d1adb44009acf2b7b093d1e885 and project 15cb4f1fac4f4d728094c3c152c1382d. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:49.504345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:18:49.517144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:18:49.627009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-128141ff-041c-4731-9c71-c7b72d61efb3 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.812093 Aug 31 12:18:49.628534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 10/25] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:18:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:18:49.641046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b0af6bf-ba10-4b32-a8c5-8da03ed62cad tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:49.641715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b0af6bf-ba10-4b32-a8c5-8da03ed62cad tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:49.710087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:49.710984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:49.755380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:49.756367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:49.757828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:49.761248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:49.763827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:49.764639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:50.039133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b0af6bf-ba10-4b32-a8c5-8da03ed62cad tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:50.048123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b0af6bf-ba10-4b32-a8c5-8da03ed62cad tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1215 microversion: 2.1 time: 0.411685 Aug 31 12:18:50.055012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 16/26] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:49 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1215 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:50.296542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:50.371404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:50.379641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:50.380844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-88eef052-2bc0-4054-884b-1e8e47ae74dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1285 microversion: 2.20 time: 0.675658 Aug 31 12:18:50.381424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 11/27] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1285 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:18:50.575590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9a4ec94b-3d08-413d-8d77-d95b65f53c07 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: .version_select at 0x7fe855b1c670>, body: {"keypair": {"name": "tempest-keypair-1376571893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkUv3TuxSydVjkihYsS4UiRURUms3A9G7DbxAHiSQQ/FdH69e0cC0gn5aQdwtJMaq9qjfNLeTfApA5d9rahThKQlxJ4CLAyblkabofZAua2P99EHKtdAv+H43K7BzmdFA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:50.720200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-9a4ec94b-3d08-413d-8d77-d95b65f53c07 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:50.739490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-9a4ec94b-3d08-413d-8d77-d95b65f53c07 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:50.920898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9a4ec94b-3d08-413d-8d77-d95b65f53c07 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.666977 Aug 31 12:18:50.924513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 17/28] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:18:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:18:50.951511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-950082458", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:51.071500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-89709b41-ba63-402a-bc4f-c31de1a06d70 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:51.072184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-89709b41-ba63-402a-bc4f-c31de1a06d70 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:51.124295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] validate_networks() for [('265e0c99-8589-4050-8cd1-2d515ee4b01d', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:18:51.391353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-89709b41-ba63-402a-bc4f-c31de1a06d70 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:51.402452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-89709b41-ba63-402a-bc4f-c31de1a06d70 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1215 microversion: 2.1 time: 0.335016 Aug 31 12:18:51.405949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 18/29] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:51 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1215 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:51.428753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:51.431868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:51.460259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:51.467697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:51.468553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:51.469493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:51.473535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:51.474160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:52.003683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:52.017276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:52.030618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:52.034668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cfe5626b-2fef-494d-a929-2a7a122303d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1333 microversion: 2.20 time: 0.618461 Aug 31 12:18:52.039029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 19/30] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1333 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:52.431061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:52.431717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:52.444566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:52.446006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:52.447791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:52.448849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:52.452152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:52.453188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:52.537311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:18:52.538445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:18:52.539531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:18:52.540164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:18:52.540724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:18:52.554031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:52.554867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:52.555723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:52.557088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:52.557825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:52.558396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:52.588238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:52.597772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for user a8320be5e9644b6699ac526913e109eb and project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:52.615855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:18:52.618803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:18:52.656204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:52.668521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1883c3b7-a098-496b-b749-f1f94310157f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1219 microversion: 2.1 time: 0.242430 Aug 31 12:18:52.671636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 20/31] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:52 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:52.714791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-be83c650-708f-4383-a489-67191a2e7ef1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.325523 Aug 31 12:18:52.717517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 12/32] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:18:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:18:52.728495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3dd709e1-20c3-487d-932d-18f9ec2c4f58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:52.729457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3dd709e1-20c3-487d-932d-18f9ec2c4f58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:52.954535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3dd709e1-20c3-487d-932d-18f9ec2c4f58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:52.966390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3dd709e1-20c3-487d-932d-18f9ec2c4f58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1221 microversion: 2.1 time: 0.237563 Aug 31 12:18:52.967301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 21/33] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:52 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:53.066509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:53.067439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:53.078275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:53.079094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:53.084367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:53.089584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:53.093013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:53.093556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:53.265861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:53.281404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:53.283717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:53.285500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-acda8673-7a47-438c-b184-af368b16793b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1339 microversion: 2.20 time: 0.224112 Aug 31 12:18:53.300293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 13/34] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:53.311449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-236652856", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:53.492130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] validate_networks() for [('265e0c99-8589-4050-8cd1-2d515ee4b01d', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:18:53.699619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:53.701768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:53.718680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:53.719786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:53.721701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:53.722539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:53.723890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:53.724515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:53.948017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:53.958279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-893fb727-e6b9-4aad-b22f-d6dee9d1f1b0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1219 microversion: 2.1 time: 0.265489 Aug 31 12:18:53.959275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 14/35] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:53 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:54.311813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:54.312441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:54.329053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:54.330681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:54.332431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:54.352446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:54.357191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:54.357897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:54.909117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:54.924332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:54.928271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:54.929845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f1682a70-f660-4dbe-a0db-218863c7edb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1339 microversion: 2.20 time: 0.623815 Aug 31 12:18:54.930963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 15/36] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1339 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:54.947825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1601638348", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72511f19-18eb-4ec4-87f2-a581216ea81a"}], "security_groups": [{"name": "tempest-securitygroup--1904489927"}], "key_name": "tempest-keypair-1376571893", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:18:55.307912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] validate_networks() for [('72511f19-18eb-4ec4-87f2-a581216ea81a', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:18:55.357706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:18:55.358787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:18:55.359601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:18:55.360248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:18:55.360967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:18:55.383210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:55.383974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:55.384661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:55.387410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:55.388101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:55.391494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:55.479395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:55.490791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for user a8320be5e9644b6699ac526913e109eb and project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:55.527951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:18:55.536765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:18:55.717023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fe55e74-d87f-472f-a1c4-52f2373a12b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.410431 Aug 31 12:18:55.725502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 22/37] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:18:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:18:55.731127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:55.737199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:55.752490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:55.753259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:55.770654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:55.777953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:55.778792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:55.780317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:56.133249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:56.142590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d9e427a6-aa75-4963-8f68-7085870aff09 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1267 microversion: 2.1 time: 0.415532 Aug 31 12:18:56.163458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 23/38] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:55 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1267 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:56.168084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c40f471-7248-4bce-8f7a-fd2d050d5f95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:56.168707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c40f471-7248-4bce-8f7a-fd2d050d5f95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:56.803466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c40f471-7248-4bce-8f7a-fd2d050d5f95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:56.814157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c40f471-7248-4bce-8f7a-fd2d050d5f95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1221 microversion: 2.1 time: 0.647403 Aug 31 12:18:56.818637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 24/39] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:56 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1221 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:56.845119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:56.845747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:56.865810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:56.898143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:56.898562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:18:56.899029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:56.899120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:18:56.899120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:18:56.899494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:56.899494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:56.899494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:56.909479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:18:56.911741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:18:56.940308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:56.940822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:56.944095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:56.946789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:56.947648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:56.950220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:56.986567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=10 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:56.994074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=25 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:56.995457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:18:57.004987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:18:57.025655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:18:57.029109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:18:57.248345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:57.260944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:57.280875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:57.284382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-136a8cd9-31bb-495a-b86b-c1190bc0cf0e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.351655 Aug 31 12:18:57.285047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 16/40] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:18:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:18:57.293963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12fe0e29-e2b0-4a0d-ad95-c30db966fc3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1339 microversion: 2.20 time: 0.464337 Aug 31 12:18:57.299462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 25/41] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1339 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:57.307355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:57.307976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:57.320573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-684c2cf2-877a-4aa2-91aa-497ad093c695 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:57.328426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-684c2cf2-877a-4aa2-91aa-497ad093c695 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:57.363525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:57.365911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:57.366461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:57.369363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:57.375921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:57.376500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:57.528077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-684c2cf2-877a-4aa2-91aa-497ad093c695 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:57.541061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-684c2cf2-877a-4aa2-91aa-497ad093c695 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1242 microversion: 2.1 time: 0.240313 Aug 31 12:18:57.544039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 26/42] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:57 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1242 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:57.621158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:57.631661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-be1cb752-a084-4593-94d5-7dbd2e81888b tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.335412 Aug 31 12:18:57.632257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 17/43] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:57 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:57.846328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:57.848524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:57.882832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:57.883567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:57.884167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:57.885034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:57.885622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:57.886254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.029835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:58.048612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-43742709-08a3-4529-9083-f092c9543708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1225 microversion: 2.1 time: 0.206763 Aug 31 12:18:58.062502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 27/44] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:57 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1225 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:58.324155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:58.324888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:58.345257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:58.345778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:58.346423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.347148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:58.347631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:58.348220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.571208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:58.574546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:58.584640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:58.585348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:58.586400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.587315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:58.588307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:58.588848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.610998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:58.621438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:58.626341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:58.628350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ede1d42f-8d5d-40d0-b88e-239137705f27 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.308485 Aug 31 12:18:58.630008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 18/45] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:18:58.654541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:58.655012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:58.683545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:58.684040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:58.684645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.685633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:58.686238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:58.688867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:58.764031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:58.775442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6331e331-0498-4f5e-8460-ac6cdebefc9b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1246 microversion: 2.1 time: 0.209378 Aug 31 12:18:58.776654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 28/46] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:58 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1246 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:58.794933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:58.804881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7edd9883-9236-45e3-a0ae-6f3515ffc32f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.154567 Aug 31 12:18:58.806074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 19/47] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:58 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:59.072361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:59.072992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:59.082938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:59.083698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:59.084147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:59.085224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:59.085710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:59.086179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:59.165773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:18:59.177029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0e8bee46-8130-433a-b740-655303f64f34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1225 microversion: 2.1 time: 0.110217 Aug 31 12:18:59.178221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 29/48] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:59 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:18:59.653115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:59.655414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:59.661459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:59.662285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:59.662902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:59.664174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:59.666555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:59.667197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:59.812350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:18:59.813145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:18:59.825797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:59.828488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:59.835976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:18:59.837650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:18:59.846008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:18:59.846683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:00.016503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:00.029025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee977be2-7439-4f74-81ce-4fde3646adf2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1246 microversion: 2.1 time: 0.233914 Aug 31 12:19:00.031501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 30/49] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:18:59 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1246 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:00.040119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:00.055288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:00.083650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:00.085329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:00.086423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:00.088749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:00.089461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:00.089902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:00.132435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:00.142561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:00.145838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:00.147479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24826263-9b2f-412a-bf2f-cfce850f7f91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.498633 Aug 31 12:19:00.168822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 20/50] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:18:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:00.201333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:00.202448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:00.233268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:00.233766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:00.234204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:00.234915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:00.235599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:00.236165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:00.286255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:00.298944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85380e3a-4628-4470-8bbf-30878b10457a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.264128 Aug 31 12:19:00.301799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 31/51] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:00 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:00.362517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:00.374895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f4966aac-088c-4f37-b618-9daabea3be18 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1225 microversion: 2.1 time: 0.179844 Aug 31 12:19:00.387287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 21/52] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:00 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1225 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:01.088816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:01.090277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:01.106629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.107226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.107789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.110318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.110950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.111718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.181909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:01.182505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:01.191405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.191902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.192334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.193145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.193514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.193932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.261387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:01.272999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-93da1d00-754c-4306-9aaf-b00d33882ed8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1246 microversion: 2.1 time: 0.220944 Aug 31 12:19:01.276370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 32/53] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:01 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1246 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:01.322573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:01.323729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:01.334370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.345886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.347741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.348804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.363402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.363402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.505763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:01.516795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5005932a-4645-4c77-b6b5-396c360d6755 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.198423 Aug 31 12:19:01.518902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 33/54] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:01 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:01.530269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:01.531095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:01.549544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.550748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.551473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.552641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:01.554293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:01.555029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:01.705537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:01.716210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c485d576-3325-4583-9142-5820bf0ed876 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1225 microversion: 2.1 time: 0.194302 Aug 31 12:19:01.722217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 34/55] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:01 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:01.732827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:01.750423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:01.752705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:01.754548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4bf800f-2d7f-4b7c-ab50-353020cb4039 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.576615 Aug 31 12:19:01.755364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 22/56] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:19:02.306153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:02.307682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:02.316096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.321976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.322747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.323739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.327059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.327728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.436658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:02.446594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d5be05ca-e31a-4c25-be2c-7d898306d801 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1246 microversion: 2.1 time: 0.144418 Aug 31 12:19:02.447670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 35/57] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:02 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1246 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:02.538521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:02.539922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:02.551057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.553717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.555114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.557126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.558765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.560021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.667958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:02.680113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd24ed24-e20d-4bf3-8d42-3c9e8274668d tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.145562 Aug 31 12:19:02.694995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 23/58] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:02 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:02.748227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:02.749117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:02.764263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.765005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.765595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.766723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.767338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.767908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.778166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:02.779217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:02.787174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.787941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.788721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.794492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:02.795118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:02.795710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:02.912810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:02.931479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-404e5cfa-d7d8-4951-8d1d-cf7e964edd35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1225 microversion: 2.1 time: 0.192084 Aug 31 12:19:02.935661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 36/59] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:02 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:03.092594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:03.102094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:03.103922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:03.105046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-561d341f-e05c-45a5-bf1a-869cb2fdfd88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.330952 Aug 31 12:19:03.121421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 24/60] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:19:03.471512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:03.472160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:03.481784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:03.482266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:03.482707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:03.483429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:03.483873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:03.484292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:03.629356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:03.639730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e1d0856e-c78f-4b11-a0dd-fde371dc6f02 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1246 microversion: 2.1 time: 0.172004 Aug 31 12:19:03.656468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 37/61] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:03 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1246 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:03.703170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:03.704896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:03.714188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:03.715491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:03.716143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:03.717309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:03.718033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:03.718659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:03.804496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:03.813627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-951e8de5-2f75-4bff-91a4-b5e2fb2617af tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.115196 Aug 31 12:19:03.823472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 25/62] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:03 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:03.954927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:03.955925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:03.967586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:03.968373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:03.971527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:03.972449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:03.973860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:03.974442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:03.985999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:04.115598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:04.118848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f7701a8-f729-4556-ae65-03520306cee1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1225 microversion: 2.1 time: 0.168312 Aug 31 12:19:04.120940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 38/63] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:03 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:04.130421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:04.134061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:04.140397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:04.140891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:04.141497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:04.142223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:04.142826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:04.144686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:04.334806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:04.349866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:04.352034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:04.353893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f15115f-7bda-4946-8627-c4536f774952 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.227613 Aug 31 12:19:04.367532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 26/64] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:04.667030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:04.667690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:04.683568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:04.684311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:04.684926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:04.685791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:04.686438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:04.687078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:04.849101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:04.849726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:04.862446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:04.863320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:04.863961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:04.864916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:04.866936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:04.867563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:04.931067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:04.950495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-667a6fe4-8943-4edf-8947-f708f8543902 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1246 microversion: 2.1 time: 0.286531 Aug 31 12:19:04.956200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 39/65] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:04 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1246 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:05.106353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:05.118844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2617f114-c945-4bb3-b3d6-4ba79609156a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.274225 Aug 31 12:19:05.132584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 27/66] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:04 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:05.145603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:05.146358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:05.163422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:05.164628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:05.165290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:05.173067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:05.186555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:05.187557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:05.379017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:05.388216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:05.394895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:05.413855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-820b5a2c-b259-4e48-9163-69024ae9c735 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1217 microversion: 2.1 time: 0.274213 Aug 31 12:19:05.432363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 40/67] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:05 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1217 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:05.433000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:05.433622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:05.434125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:05.435095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:05.438602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:05.442504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:05.449116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:05.938977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:05.955775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:05.957760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:05.959119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b4c9f7b-c483-4f1e-a98c-7134bf2d2850 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.584965 Aug 31 12:19:05.967372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 28/68] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:05.982919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:05.984204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:05.990124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:05.992004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:05.992649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:05.993279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:05.994233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:05.994842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:05.995440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:06.131383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:06.147300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cac77728-3dc2-4dbe-8ef4-ff90f0b16c3e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1294 microversion: 2.1 time: 0.165754 Aug 31 12:19:06.149251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 41/69] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:05 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1294 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:06.152605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:06.153228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:06.168484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:06.168982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:06.169417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:06.170134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:06.171049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:06.171520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:06.296538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:06.307684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec696612-8702-4370-b744-5e70a9a7e89e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1273 microversion: 2.1 time: 0.159521 Aug 31 12:19:06.308653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 29/70] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:06 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:06.458357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:06.458960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:06.473078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:06.474286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:06.477229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:06.477672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:06.480456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:06.481054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:06.592178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:06.602639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6853481b-e7f3-46d1-b609-8b256ad6e581 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1273 microversion: 2.1 time: 0.148737 Aug 31 12:19:06.605498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 42/71] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:06 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:06.985714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:06.987142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:06.989314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=8 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:06.995552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:06.996044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:06.996476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:06.997189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:06.997638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:06.998053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.028706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:07.170022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:07.170625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:07.171259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:07.173674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:07.180969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:07.181897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:07.182388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:07.182830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.183737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:07.184142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:07.184403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:07.184865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.186049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5db6b96c-f6e4-4b95-96b0-5227fa6c78ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.204587 Aug 31 12:19:07.186840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 30/72] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:07.264542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:07.272429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-47f3b266-7b2b-4d69-98ae-99a3245a8151 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1294 microversion: 2.1 time: 0.106134 Aug 31 12:19:07.273026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 43/73] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:07 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:07.330045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:07.330633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:07.336885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:07.337383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:07.337807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.338547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:07.338956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:07.339395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.472241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:07.480615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a46be81a-dca5-48e5-a189-2be71b362b1a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.154407 Aug 31 12:19:07.481273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 31/74] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:07 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:07.624940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:07.626551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:07.629673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=24 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:07.647349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:07.651220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:07.651930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.652829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:07.653428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:07.655918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:07.770033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:07.785277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4a4fee8d-1557-4d0d-aac6-81f5b8b9430b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1273 microversion: 2.1 time: 0.163654 Aug 31 12:19:07.791412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 44/75] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:07 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:08.213626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:08.215560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:08.223868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.224283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.225254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.227087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.227750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.228346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.316477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:08.317874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:08.334252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.342121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.351483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.352391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.352918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.353368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.504676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:08.513846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41c933a5-f3c1-41da-9814-648b1498e6af tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1294 microversion: 2.1 time: 0.219332 Aug 31 12:19:08.531889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 45/76] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:08 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:08.534641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:08.536876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:08.537488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:08.546777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.547354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.547793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.548500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.548955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.549411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.553766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:08.555334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:08.556472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-44e487cb-d30e-4264-a262-85f331ed8af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.350526 Aug 31 12:19:08.557100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 32/77] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:08.778233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:08.786847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0587df19-af51-4e1e-b717-fcc2e07a881a tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.253686 Aug 31 12:19:08.787484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 46/78] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:08 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:08.811521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:08.812159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:08.831332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.831739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.832180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.832900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:08.833527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:08.833946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:08.925459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:08.941562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f35f580-924c-4c56-8f14-95f88e93b8ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1273 microversion: 2.1 time: 0.134898 Aug 31 12:19:08.942261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 33/79] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:08 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:09.544168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:09.546792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:09.561624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:09.562365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:09.562896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:09.563822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:09.564265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:09.564677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:09.583541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:09.584159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:09.597708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:09.600338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:09.601080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:09.602299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:09.602959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:09.604095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:09.698520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:09.709671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e99e942-1b40-4781-87f1-b7c9e16f9427 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1294 microversion: 2.1 time: 0.169941 Aug 31 12:19:09.711142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 47/80] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:09 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:09.818586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:09.820197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:09.833157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:09.835464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:09.837342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:09.838854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:09.840132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:09.840917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:10.133285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:10.143215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:10.161270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:10.164404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:10.166078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd973438-df6c-43d2-8624-bd5ea1bf57a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.588975 Aug 31 12:19:10.166589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 34/81] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:19:10.181442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f039d24e-e319-4a5c-95bd-27a1f746e21e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.359324 Aug 31 12:19:10.183554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:10.184137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:10.185466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 48/82] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:09 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:10.203135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:10.204000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:10.204500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:10.205403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:10.206246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:10.206246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:10.324347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:10.339763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4713a0d5-a8a0-426f-a05c-7db8932ed609 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1273 microversion: 2.1 time: 0.158407 Aug 31 12:19:10.355368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 35/83] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:10 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:10.738785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:10.739422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:10.746749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:10.747254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:10.747677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:10.748372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:10.748850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:10.749371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:10.848226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:10.867582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b4ee148b-eb31-4b83-86ec-b23305f03978 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1294 microversion: 2.1 time: 0.132437 Aug 31 12:19:10.869932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 49/84] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:10 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:11.211531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:11.212738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:11.213143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:11.213869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:11.224526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:11.226350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:11.226851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:11.228413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:11.229157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:11.230036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:11.230841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:11.231353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:11.231782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:11.232236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:11.233825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:11.235163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:11.885756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:11.903519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a78b8776-e940-415f-8ea8-15a6f643b802 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.693986 Aug 31 12:19:11.904151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 50/85] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:11 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:11.910039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:11.910702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:11.920155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:11.920835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:11.921263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:11.922103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:11.924022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:11.924022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:11.958114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:11.970481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:11.972527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:11.973922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d13c4bf1-6717-42ca-a7a8-429e5b009239 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.766948 Aug 31 12:19:11.988982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 36/86] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:11.991840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:11.992561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:11.999542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:12.000461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:12.000956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:12.001659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:12.002104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:12.002517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:12.050576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:12.061758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e664f06f-5acb-427e-acd9-70ca3e2ebb88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1279 microversion: 2.1 time: 0.156182 Aug 31 12:19:12.062414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 51/87] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:11 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:12.118948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:12.129500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22cf8906-c1c0-4503-8556-451c25c76edd tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1300 microversion: 2.1 time: 0.142136 Aug 31 12:19:12.143785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 37/88] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:11 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:12.926634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:12.927381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:12.953495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:12.957912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:12.958415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:12.959488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:12.959626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:12.963124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.084597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07cb8a7-16be-4a30-95c4-38164dc5539e", "tag": "a5dd515b-f344-466a-a4a9-792197449cc3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:13.101003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.101788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.102273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.129831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Creating event network-changed:a5dd515b-f344-466a-a4a9-792197449cc3 for instance f07cb8a7-16be-4a30-95c4-38164dc5539e on hv-cinder-85535 Aug 31 12:19:13.130566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 12:19:13.131029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44598216-3c66-4068-b23a-22029432e39d req-65d25fdb-8524-4f44-b656-e684cced936b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 12:19:13.132229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.132787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.133301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.134123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.134670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.135184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.148140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.compute.rpcapi [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 12:19:13.149262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] Releasing lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 12:19:13.166808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ab9dd2b5-d578-4413-8952-1e3a783dd382 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272563 Aug 31 12:19:13.167791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 52/89] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:13.177782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:13.178592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:13.186342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.186794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.187537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.188541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.189116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.189541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.592032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:13.600642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-addc8e2d-0245-4346-8ca1-11dbd6164a03 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.679053 Aug 31 12:19:13.601224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 38/90] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:12 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:13.606386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:13.607310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:13.612665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:13.614418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.615107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.615775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.616930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.617589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.618483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.623136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:13.624620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:13.628526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2dc66018-5d5f-436a-b358-77df782018d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.455823 Aug 31 12:19:13.634053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 53/91] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:13.641321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:13.642247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:13.653322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.653945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.654507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.655341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:13.655893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:13.656671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:13.975793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:13.984125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db137598-1194-4d92-8b24-83f27dcc6dd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.381565 Aug 31 12:19:13.985015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 39/92] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:13 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:13.997866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:14.005807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-255d8a82-e36d-4dda-918e-1c8f3b0216cb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.370364 Aug 31 12:19:14.006392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 54/93] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:13 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:14.623501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:14.624115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:14.630913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:14.631431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:14.631887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:14.632580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:14.633024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:14.633435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:14.658806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:14.659405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:14.666315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:14.667075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:14.668021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:14.669051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:14.669650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:14.670358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:14.676594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:14.855677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:14.864561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61578417-33d4-45e5-8df1-227d68898a80 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.244941 Aug 31 12:19:14.870940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 40/94] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:14 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:15.005533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:15.006314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:15.012862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.013567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.014158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.014999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.015767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.016418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.048701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:15.058323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:15.059791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:15.060999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58a24797-dfa2-42a0-87cf-c46c857ecf24 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.406371 Aug 31 12:19:15.075954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 55/95] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:15.086632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:15.088960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:15.096995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.097893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.098354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.099225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.099705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.100153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.558569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:15.567995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-74d522cd-2703-4509-b275-5496c583c1f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.566316 Aug 31 12:19:15.579266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 41/96] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:15 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:15.579266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2c92aa-79af-4b50-93ca-50d2482f95d9", "tag": "f1f3d314-f82c-4dad-8e8c-c4b929422a21"}, {"name": "network-changed", "server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:15.594367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.595334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.596640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.619763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Creating event network-changed:f1f3d314-f82c-4dad-8e8c-c4b929422a21 for instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 on hv-cinder-85535 Aug 31 12:19:15.620439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Creating event network-changed:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:19:15.621077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 12:19:15.621596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ea80a5ef-367c-4c25-abb6-cdd7ee3e8b7f req-e99472b6-1887-459b-9ebb-97cb8c9d7afb service nova] Acquired lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 12:19:15.623686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.624655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.625361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.627010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.628261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.628880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.640737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.compute.rpcapi [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 12:19:15.642831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f947245-88c5-4246-9091-b618fb995328 None None] Releasing lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 12:19:15.643031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:15.656655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3e3378f1-845f-417e-a858-209e80e59578 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.579370 Aug 31 12:19:15.658081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 56/97] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:15 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:15.677258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f947245-88c5-4246-9091-b618fb995328 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107009 Aug 31 12:19:15.678462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 42/98] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:15.906391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:15.907131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:15.922752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.923781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.928198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:15.929305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:15.929959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:15.930576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:16.089939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:16.091665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:16.106817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:16.108254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:16.109358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:16.111567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:16.113476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:16.114125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:16.591495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:16.605089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de70bd11-0b2f-49aa-9fe8-a64537f32efe tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.703787 Aug 31 12:19:16.606305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 57/99] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:15 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:16.613333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:16.614411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:16.626900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:16.629291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:16.630010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:16.631302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:16.632685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:16.633433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:16.714000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:16.734459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:16.737954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:16.740022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-be2e22d5-47ea-46eb-9c69-036d496a459c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.654567 Aug 31 12:19:16.772643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 43/100] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:16.790459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:16.791134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:16.800740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:16.801229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:16.801656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:16.806644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:16.807164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:16.808493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:17.052230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:17.062712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a70ffb0-3f48-41cc-b793-a01db3660157 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.454479 Aug 31 12:19:17.063497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 58/101] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:16 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:17.085758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:17.094054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d98fedb-0c69-448a-b9df-b7ab9deb131b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.320017 Aug 31 12:19:17.095347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 44/102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:16 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:17.148368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a0e97b-c365-4cb4-b591-576e3babe5d6", "tag": "20e76311-a9be-4882-8e61-7c32fc291409"}, {"name": "network-changed", "server_uuid": "991ff4bb-6c07-4c69-b673-272a1e178100", "tag": "db14b681-db73-4b8e-b264-f17550194eec"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:17.159410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:17.159907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:17.160452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:17.175502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] Creating event network-changed:20e76311-a9be-4882-8e61-7c32fc291409 for instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 on hv-cinder-85535 Aug 31 12:19:17.175998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] Creating event network-changed:db14b681-db73-4b8e-b264-f17550194eec for instance 991ff4bb-6c07-4c69-b673-272a1e178100 on hv-cinder-85535 Aug 31 12:19:17.182593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-aa014a5b-735e-4278-848b-30b623f83be8 req-78bcd167-6f64-40d8-a6b4-1b2688da11fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.108481 Aug 31 12:19:17.183209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 59/103] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:17.637663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:17.638272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:17.646692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:17.647635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:17.648351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:17.649050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:17.649544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:17.650045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:17.655136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:17.770698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:17.772973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:17.780300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:17.781905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:17.782831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:17.784086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:17.784770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:17.785448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:17.807801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:17.819471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-093445b8-a9cb-4456-8238-789e50729a77 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.192651 Aug 31 12:19:17.820905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 45/104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:17 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:18.008769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:18.021286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:18.023098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:18.024904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b72c805-315d-467f-9037-c1b383f4e86b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.260600 Aug 31 12:19:18.025593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 60/105] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:18.084437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:18.085207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:18.093823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:18.094306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:18.094856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:18.095439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:18.095963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:18.096579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:18.117406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:18.117923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:18.124464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:18.125045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:18.125478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:18.126663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:18.126779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:18.127194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:18.306255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:18.310614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:18.315075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab9c583a-54b7-4439-a2c4-4465bf187ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.235401 Aug 31 12:19:18.315687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 46/106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:18 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:18.319775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f2ce1acf-7c83-47e6-b963-ed0f56c34878 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.206997 Aug 31 12:19:18.320641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 61/107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:18 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:18.841139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:18.841738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:18.848657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:18.849141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:18.849763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:18.850446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:18.850893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:18.851334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:19.026927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:19.036373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e8eae55-be4f-4136-971c-9178d5e95045 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.199002 Aug 31 12:19:19.037100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 47/108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:18 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:19.057163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:19.057988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:19.067070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:19.067760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:19.068416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:19.069462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:19.070118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:19.070749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:19.337416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:19.338988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:19.351265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:19.352038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:19.352863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:19.355004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:19.357536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:19.358081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:19.360832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:19.372041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:19.374820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:19.378601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e3383a4f-a63f-4852-b637-525ebc5ab174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.326459 Aug 31 12:19:19.394185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 62/109] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:19.409814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:19.415061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:19.427582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:19.428327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:19.428903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:19.434748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:19.435566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:19.436200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:20.342265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:20.363109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6035d0af-9752-4796-84dd-a674ac5321c1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.962732 Aug 31 12:19:20.365929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 63/110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:19 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:20.378565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:20.379393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:20.391425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:20.402605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:20.408052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3c2ccdb6-31e1-4b69-850a-2f153c1e48b7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 1.074479 Aug 31 12:19:20.408324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:20.409026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:20.409837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:20.410848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:20.411220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 48/111] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:19 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:20.415949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:20.421473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:20.421756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:20.440371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:20.440864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:20.441749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:20.442638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:20.443251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:20.443814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:20.688583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:20.696875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30e0f560-0f76-4b02-bfc8-831b1b4a28d1 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.329254 Aug 31 12:19:20.715999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 64/112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:20 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:20.806707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:20.815891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:20.817319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:20.818461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9bb4f58e-9835-42b8-835d-c175854fbb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.405699 Aug 31 12:19:20.826592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 49/113] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:21.391012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:21.392334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:21.407685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:21.408604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:21.413052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:21.414760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:21.415912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:21.416943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:21.434352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:21.435097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:21.450254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:21.452214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:21.456235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:21.458668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:21.459353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:21.460696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:21.935470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:21.945524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8536654f-902e-4885-a035-954f74c9b782 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.515155 Aug 31 12:19:21.946145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 50/114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:21 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:21.962562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:21.974085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b327e2ad-fed9-411e-9b34-1a9abad976d0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.588135 Aug 31 12:19:21.983912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 65/115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:21 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:22.000411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:22.001287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:22.012646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.013276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.015987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:22.016935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.020891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.021513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:22.412663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-b56c6aa6-90c5-404c-a65f-73475e3e7a5b req-4222f1d6-cdd4-4277-b878-61f04451e4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "name": "network-vif-plugged", "status": "completed", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:22.438473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b56c6aa6-90c5-404c-a65f-73475e3e7a5b req-4222f1d6-cdd4-4277-b878-61f04451e4b4 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.439830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b56c6aa6-90c5-404c-a65f-73475e3e7a5b req-4222f1d6-cdd4-4277-b878-61f04451e4b4 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.440434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b56c6aa6-90c5-404c-a65f-73475e3e7a5b req-4222f1d6-cdd4-4277-b878-61f04451e4b4 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:22.461897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-b56c6aa6-90c5-404c-a65f-73475e3e7a5b req-4222f1d6-cdd4-4277-b878-61f04451e4b4 service nova] Creating event network-vif-plugged:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:19:22.473545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-b56c6aa6-90c5-404c-a65f-73475e3e7a5b req-4222f1d6-cdd4-4277-b878-61f04451e4b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524045 Aug 31 12:19:22.480632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 51/116] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:22.492462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:22.496144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:22.511699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.515965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.520782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:22.522564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.523922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.524567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:22.720693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:22.737308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de9634eb-c835-46e1-be85-282227a10290 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.752126 Aug 31 12:19:22.739283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 66/117] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:21 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:22.973752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:22.974360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:22.982552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.983191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.983892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:22.984762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:22.985556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:22.986416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:23.148367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:23.250816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:23.260868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:23.263282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:23.264697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c104ec84-dc97-4a12-ae7c-23067caed0b7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.781112 Aug 31 12:19:23.265518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 52/118] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:23.287914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:23.288825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:23.297071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:23.297907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:23.298570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:23.299916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:23.301353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:23.302251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:23.816743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:23.827181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c5f0594-007f-42de-ba19-a5c9275b8f9c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.857552 Aug 31 12:19:23.831583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 67/119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:22 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:23.845070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:23.847414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:23.854603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:23.855579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:23.856010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:23.856857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:23.857676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:23.858584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:23.909867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:23.922198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-720f6d64-9a67-4ec8-ad28-92cf8f2a79ba tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.640006 Aug 31 12:19:23.922851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 53/120] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:23 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:24.043695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:24.053257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1fa0e99c-39cc-465a-b124-4c9745f26ceb tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.219635 Aug 31 12:19:24.054400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 68/121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:23 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:24.293694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:24.294731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:24.305969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:24.306872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:24.307565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:24.308846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:24.309543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:24.310353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:24.462666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:24.472175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:24.473655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:24.474707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd6a492f-6aa1-429b-b983-b6728f232ed0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.186271 Aug 31 12:19:24.482159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 54/122] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:24.851877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:24.853876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:24.862495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:24.863169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:24.864252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:24.865654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:24.866281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:24.867324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:24.946116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:24.946685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:24.955864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:24.956671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:24.956781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:24.958027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:24.958027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:24.958339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:25.071507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:25.097413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-32bd67eb-79dc-4f0f-8cf6-6683fea56c74 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.236670 Aug 31 12:19:25.111821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 69/123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:24 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:25.118094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:25.118705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:25.125851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:25.126583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:25.127181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:25.128044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:25.128635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:25.129050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:25.140475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:25.148560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a39bed89-c380-4db9-91a8-d732f0e3db24 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.206389 Aug 31 12:19:25.150410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 55/124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:24 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:25.298301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:25.308641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d2596ed2-f3b8-4323-b86e-8667a8bb2f48 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.195256 Aug 31 12:19:25.309249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 70/125] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:25 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:25.499664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:25.500530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:25.506690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:25.507314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:25.507941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:25.508720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:25.509258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:25.509829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:25.639509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:25.650110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:25.660108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:25.661632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:25.662976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-135b78f9-4afb-4bd3-8fc4-06e2890e49dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.168569 Aug 31 12:19:25.663756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 56/126] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:26.118006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:26.118798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:26.125499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.125986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.126420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.127375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.127833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.128260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.170132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:26.174631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:26.187514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.188767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.189197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.190324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.190997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.191587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.379104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:26.395898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2cbd2fcf-65c7-40d9-9de1-e95840bc58d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.281621 Aug 31 12:19:26.419540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 71/127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:26 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:26.425128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:26.426552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:26.427166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:26.433655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4425cb64-83a5-4b22-8cf2-0732552bd8ad tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.267995 Aug 31 12:19:26.434225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 57/128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:26 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:26.434345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.434842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.435184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.435929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.436391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.436894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.456503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:26.609650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:26.618457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8b918c1d-dc0c-4395-b467-92e7aaf9f455 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.197700 Aug 31 12:19:26.619187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 72/129] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:26 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:26.686121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:26.686744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:26.692873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.693359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.693784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.694478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:26.694927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:26.695371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:26.841098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:26.849686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:26.851111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:26.852659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b0c8cf8-d27e-4844-8b67-595c62bd4147 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.170516 Aug 31 12:19:26.853223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 58/130] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:27.426511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:27.427724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:27.435878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.436649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.438511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.440236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.440861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.441631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.454174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:27.455460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:27.457586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:27.472625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.473110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.483864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.486343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.488661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.489554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.800816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:27.802211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:27.810866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ef96072-d75e-4838-8040-6baf9160f94e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.388680 Aug 31 12:19:27.811025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4eceb4a6-40fa-4647-9801-2e45be7c0076 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.360500 Aug 31 12:19:27.821975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 73/131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:27 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:27.821975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:27.821975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:27.826345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 59/132] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:27 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:27.832186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-d5245f80-e57c-4a57-9975-3cdcf8b4c9be req-05eb864b-b156-437d-a96b-8622311bcce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2c92aa-79af-4b50-93ca-50d2482f95d9", "name": "network-vif-plugged", "status": "completed", "tag": "f1f3d314-f82c-4dad-8e8c-c4b929422a21"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:27.837566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.838053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.838475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.839169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.839675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.840111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.845673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d5245f80-e57c-4a57-9975-3cdcf8b4c9be req-05eb864b-b156-437d-a96b-8622311bcce8 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.846147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d5245f80-e57c-4a57-9975-3cdcf8b4c9be req-05eb864b-b156-437d-a96b-8622311bcce8 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.846565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-d5245f80-e57c-4a57-9975-3cdcf8b4c9be req-05eb864b-b156-437d-a96b-8622311bcce8 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.858716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-d5245f80-e57c-4a57-9975-3cdcf8b4c9be req-05eb864b-b156-437d-a96b-8622311bcce8 service nova] Creating event network-vif-plugged:f1f3d314-f82c-4dad-8e8c-c4b929422a21 for instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 on hv-cinder-85535 Aug 31 12:19:27.864236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-d5245f80-e57c-4a57-9975-3cdcf8b4c9be req-05eb864b-b156-437d-a96b-8622311bcce8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036363 Aug 31 12:19:27.864830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 60/133] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:27.877618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:27.880906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:27.888354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.889450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.892151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:27.893029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:27.893589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:27.894079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:28.057785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:28.067656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-334ffd1e-dda2-4683-86ca-a8ec2435b946 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.254347 Aug 31 12:19:28.068507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 74/134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:27 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:28.088559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:28.098458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:28.100986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:28.102239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d237cd89-2f98-4ab8-ae4b-750d2bb3b4ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.229657 Aug 31 12:19:28.102794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 61/135] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:28.833476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:28.834045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:28.840964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:28.841716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:28.842143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:28.842875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:28.843351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:28.843770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:28.846888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:28.847530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:28.853731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:28.854212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:28.854641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:28.855394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:28.855838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:28.856257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:29.039214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:29.042645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:29.047551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c0f94e5-84bf-4745-acb1-73394f2aa360 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.218592 Aug 31 12:19:29.048125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 75/136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:28 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:29.051124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1a9edbe-9069-4cc5-8313-85ea54b38337 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.208821 Aug 31 12:19:29.051738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 62/137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:28 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:29.089057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:29.089660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:29.096423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:29.096904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:29.097300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:29.098015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:29.098458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:29.098865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:29.125861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:29.126468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:29.132914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:29.133375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:29.133834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:29.134528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:29.134975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:29.135426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:29.139762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:29.280656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:29.289090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6cf734d6-1ab8-49e9-8d5e-63dcd4be32a0 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.203745 Aug 31 12:19:29.289943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 76/138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:29 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:29.309426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:29.319435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:29.320858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:29.321965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14e618d6-b600-4138-959a-4ba062a7799a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.200332 Aug 31 12:19:29.322526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 63/139] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:29.887482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a99a6880-2c6f-42f9-8f5b-ba79247ad4ad req-1a091caa-855f-477c-aca1-38912d7f5872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07cb8a7-16be-4a30-95c4-38164dc5539e", "name": "network-vif-plugged", "status": "completed", "tag": "a5dd515b-f344-466a-a4a9-792197449cc3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:29.896986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a99a6880-2c6f-42f9-8f5b-ba79247ad4ad req-1a091caa-855f-477c-aca1-38912d7f5872 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:29.897464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a99a6880-2c6f-42f9-8f5b-ba79247ad4ad req-1a091caa-855f-477c-aca1-38912d7f5872 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:29.897889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a99a6880-2c6f-42f9-8f5b-ba79247ad4ad req-1a091caa-855f-477c-aca1-38912d7f5872 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:29.910248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a99a6880-2c6f-42f9-8f5b-ba79247ad4ad req-1a091caa-855f-477c-aca1-38912d7f5872 service nova] Creating event network-vif-plugged:a5dd515b-f344-466a-a4a9-792197449cc3 for instance f07cb8a7-16be-4a30-95c4-38164dc5539e on hv-cinder-85535 Aug 31 12:19:29.915181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a99a6880-2c6f-42f9-8f5b-ba79247ad4ad req-1a091caa-855f-477c-aca1-38912d7f5872 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031493 Aug 31 12:19:29.915800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 77/140] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:30.067995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:30.068602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:30.072191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:30.072886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:30.075628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.076084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.076531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.077295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.077660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.078153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.079720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.080212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.080638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.081344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.081789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.082207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.276587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:30.284355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:30.286409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37534542-e770-4c6b-bae3-e59ec97498f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.222444 Aug 31 12:19:30.287095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 64/141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:30 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:30.294993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a1a58395-36f5-49d5-a2ea-0e4bf99b1c3b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.226485 Aug 31 12:19:30.296172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 78/142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:30 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:30.310988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:30.311640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:30.318262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.318750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.319181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.319913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.320362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.320784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.350905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:30.351735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:30.357940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.358821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.359301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.360006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:30.360467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:30.360876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:30.542464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:30.546733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:30.552417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-67f54c3a-b266-4de4-a946-809df3b0494f tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.245260 Aug 31 12:19:30.553228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 65/143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:30 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:30.555674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:30.557110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:30.558193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30af7713-bf5b-4784-a3d0-4cba38b01312 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.211277 Aug 31 12:19:30.558885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 79/144] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:31.310501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:31.311091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:31.317504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:31.318174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:31.320694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.321189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.321625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.322487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.323061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.323661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.329249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.329770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.330199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.330897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.331361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.331777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.565189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:31.567481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:31.574628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b389727f-6914-4e63-a24f-35b0af9a4978 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.268457 Aug 31 12:19:31.577253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85a4c58b-3b97-4aad-8382-8139d24caac4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.264808 Aug 31 12:19:31.588718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 80/145] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:31 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:31.589617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 66/146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:31 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:31.597819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:31.599480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:31.603505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:31.604559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:31.609991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.610489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.610921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.611651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.612106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.612530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.614488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.615318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.615934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.616790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:31.617380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:31.617800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:31.815294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:31.823823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:31.825230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:31.831881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-39ce0d53-a77f-4f0f-ad6d-6358629a11e0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1406 microversion: 2.20 time: 0.239263 Aug 31 12:19:31.833184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 67/147] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:31.850991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:31.862946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a530264-261b-4a7f-856d-f2bcaa2f3c60 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.271498 Aug 31 12:19:31.863287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 81/148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:31 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:32.602516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:32.603338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:32.607748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:32.609032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:32.614598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:32.615828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:32.617180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:32.617962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:32.618843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:32.619022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:32.620075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:32.620329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:32.621070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:32.621561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:32.621748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:32.622753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:32.926151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:32.959543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f27fe2c2-e9e6-4462-97d0-f5835eff68fe tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.356085 Aug 31 12:19:32.960409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 82/149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:32 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:32.967091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:32.976818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eae4abb1-0f97-475e-a815-b5546c6f1d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.380947 Aug 31 12:19:32.977412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 68/150] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:32 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:32.981870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:32.984031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:32.993535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:32.994527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:33.002647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.003157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.003624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.004623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.005080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.005501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.008724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.012466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.013064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.013917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.014508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.014989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.348626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:33.364243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-271e6b3b-a46a-4ce4-9559-30f3051bb055 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1315 microversion: 2.1 time: 0.383941 Aug 31 12:19:33.365890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 69/151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:32 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:33.379848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-0ee6b231-fc36-4482-bda6-1e5336af84f8 req-79036b03-1ddc-4e9b-abc0-5c8652a34357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a0e97b-c365-4cb4-b591-576e3babe5d6", "name": "network-vif-plugged", "status": "completed", "tag": "20e76311-a9be-4882-8e61-7c32fc291409"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:33.405100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:33.406529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0ee6b231-fc36-4482-bda6-1e5336af84f8 req-79036b03-1ddc-4e9b-abc0-5c8652a34357 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.407319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0ee6b231-fc36-4482-bda6-1e5336af84f8 req-79036b03-1ddc-4e9b-abc0-5c8652a34357 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.411074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0ee6b231-fc36-4482-bda6-1e5336af84f8 req-79036b03-1ddc-4e9b-abc0-5c8652a34357 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.418873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:33.422550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:33.424437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ac5de1b-859c-491e-bd47-368bb557bead tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1597 microversion: 2.20 time: 0.461893 Aug 31 12:19:33.425470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 83/152] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:19:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1597 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:19:33.441551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-0ee6b231-fc36-4482-bda6-1e5336af84f8 req-79036b03-1ddc-4e9b-abc0-5c8652a34357 service nova] Creating event network-vif-plugged:20e76311-a9be-4882-8e61-7c32fc291409 for instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 on hv-cinder-85535 Aug 31 12:19:33.460599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:33.468707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-0ee6b231-fc36-4482-bda6-1e5336af84f8 req-79036b03-1ddc-4e9b-abc0-5c8652a34357 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094783 Aug 31 12:19:33.469183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:33.470057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 70/153] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:33.481236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.482271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.499267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.504018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:33.508701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:33.510438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:33.723967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66b6ddf0-86c9-4654-bba5-131c23b6760f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.277769 Aug 31 12:19:33.724896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 84/154] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Aug 31 12:19:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:19:33.984057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:33.984755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:34.008103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:34.009628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:34.024849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:34.027159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:34.027643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:34.028416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:34.028878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:34.029306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:34.033496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:34.033994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:34.034433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:34.036065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:34.036065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:34.036383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:34.843205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:34.861710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e15bf7a8-31db-41fa-8430-ff7711f10d22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.860044 Aug 31 12:19:34.873451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:34.880616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 85/155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:33 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:34.885125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a25f8dad-e50c-455d-917d-e3db92512093 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.906929 Aug 31 12:19:34.890082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 71/156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:33 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:34.901741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:34.902725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:34.910649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:34.911266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:34.911759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:34.912599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:34.913062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:34.913484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:35.306447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:35.315281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65d4d6e5-5889-4f88-b49e-523ec6226abc tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1503 microversion: 2.1 time: 0.431599 Aug 31 12:19:35.320552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 86/157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:34 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1503 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:35.492758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-266c161d-ecc0-4fd6-8b50-370dccb9d69d req-9060ccd2-a99a-4aef-a0dc-f250650ea637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991ff4bb-6c07-4c69-b673-272a1e178100", "name": "network-vif-plugged", "status": "completed", "tag": "db14b681-db73-4b8e-b264-f17550194eec"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:35.512083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-266c161d-ecc0-4fd6-8b50-370dccb9d69d req-9060ccd2-a99a-4aef-a0dc-f250650ea637 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:35.513035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-266c161d-ecc0-4fd6-8b50-370dccb9d69d req-9060ccd2-a99a-4aef-a0dc-f250650ea637 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:35.513793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-266c161d-ecc0-4fd6-8b50-370dccb9d69d req-9060ccd2-a99a-4aef-a0dc-f250650ea637 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:35.537031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-266c161d-ecc0-4fd6-8b50-370dccb9d69d req-9060ccd2-a99a-4aef-a0dc-f250650ea637 service nova] Creating event network-vif-plugged:db14b681-db73-4b8e-b264-f17550194eec for instance 991ff4bb-6c07-4c69-b673-272a1e178100 on hv-cinder-85535 Aug 31 12:19:35.550835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-266c161d-ecc0-4fd6-8b50-370dccb9d69d req-9060ccd2-a99a-4aef-a0dc-f250650ea637 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060967 Aug 31 12:19:35.568806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 72/158] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:35.884916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:35.886145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:35.895049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:35.898061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:35.898567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:35.901823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:35.903974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:35.904483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:35.913396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:35.914084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:35.925897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:35.926397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:35.927144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:35.929030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:35.931441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:35.932050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:36.427941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:36.452587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e7a295f-ed47-4a40-b13f-b93ed8f27cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1321 microversion: 2.1 time: 0.560435 Aug 31 12:19:36.456702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 87/159] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:35 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:36.471799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-eab07f0b-714c-4905-8853-ba3aaf9fb3b8 req-fb582f97-2f7d-454c-aca8-0379bf564f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:36.493742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-eab07f0b-714c-4905-8853-ba3aaf9fb3b8 req-fb582f97-2f7d-454c-aca8-0379bf564f25 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:36.495348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-eab07f0b-714c-4905-8853-ba3aaf9fb3b8 req-fb582f97-2f7d-454c-aca8-0379bf564f25 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:36.495999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-eab07f0b-714c-4905-8853-ba3aaf9fb3b8 req-fb582f97-2f7d-454c-aca8-0379bf564f25 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:36.510125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-eab07f0b-714c-4905-8853-ba3aaf9fb3b8 req-fb582f97-2f7d-454c-aca8-0379bf564f25 service nova] Creating event network-changed:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:19:36.519849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-eab07f0b-714c-4905-8853-ba3aaf9fb3b8 req-fb582f97-2f7d-454c-aca8-0379bf564f25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061061 Aug 31 12:19:36.521014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 88/160] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:36.528390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:36.538923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f6c55a3-ae88-4762-998d-69873209d5c7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.629905 Aug 31 12:19:36.544244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 73/161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:35 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:36.996741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f22c9f5-4a55-461a-958c-d3f281bc16f0"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:37.000328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:37.007584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:37.008062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:37.009020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:37.009933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:37.010388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:37.011193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:37.477030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:37.477985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:37.504197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:37.504696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:37.505135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:37.505843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:37.506574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:37.507142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:37.773994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:37.805136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-faae2565-801f-40ac-aea7-0246deab86f6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "POST /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814968 Aug 31 12:19:37.806404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 89/162] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:19:36 2022] POST /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:37.829974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:37.830904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:37.837222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=93 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:37.839459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:37.842069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:37.842976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:37.845946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:37.859627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:37.860178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:37.992195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:38.008869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84c744b1-220c-4de2-b601-fb9c4b8be47b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1515 microversion: 2.1 time: 0.535267 Aug 31 12:19:38.010198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 74/163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:37 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1515 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:38.047928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:38.053870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:38.077999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:38.083037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:38.083786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:38.088656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:38.089467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:38.092482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:38.288891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'flavor' on Instance uuid 04a0e97b-c365-4cb4-b591-576e3babe5d6 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:19:38.450092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf7ddf38-c086-44d0-8251-7a70ad9a6c39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6/action" status: 200 len: 32 microversion: 2.1 time: 0.418180 Aug 31 12:19:38.450874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 75/164] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:19:38 2022] POST /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6/action => generated 32 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:19:38.460888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:38.462005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:38.469940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:38.470437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:38.470865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:38.471596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:38.472101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:38.473031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:38.585464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:38.595534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b51bd8f3-b50d-4d61-9f06-4c266d2b3039 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.787306 Aug 31 12:19:38.596423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 90/165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:37 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:38.848575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:38.856969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2d613f3-80bb-4e2d-bd05-c76758300169 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.400442 Aug 31 12:19:38.857581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 76/166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:38 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:39.619409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:39.620025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:39.631429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:39.632145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:39.632739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:39.633808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:39.634392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:39.635303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:39.825194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:39.833163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-90c3bf71-9181-4e57-927d-2cda8e0b9451 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.217721 Aug 31 12:19:39.833738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 91/167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:39 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:39.878201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:39.879150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:39.885252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:39.885812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:39.886311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:39.887013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:39.887884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:39.888366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:40.028884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:40.038830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d1a8c32d-f942-457a-a3bd-c5c046633b8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.164472 Aug 31 12:19:40.039733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 77/168] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:39 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:40.855775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:40.856289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:40.863361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:40.863848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:40.864257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:40.864942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:40.865365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:40.865773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:40.998319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:41.006710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-69b61fa1-8638-46be-b86d-81c86caf715c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.155089 Aug 31 12:19:41.007313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 92/169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:40 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:41.060946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:41.061632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:41.067589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:41.068256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:41.068671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:41.069449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:41.070162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:41.070598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:41.218208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:41.226320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04a49774-dd35-449f-a8c8-b6940e3b60f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.169602 Aug 31 12:19:41.226893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 78/170] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:41 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:42.029158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:42.030995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:42.037731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:42.038662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:42.039300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:42.040183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:42.040840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:42.041494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:42.252213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:42.253661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:42.263274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:42.264290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:42.264995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:42.265847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:42.266345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:42.266885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:42.271799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:42.375650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:42.383763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4ef04b2-de7f-41b7-b081-21e6c5159708 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.358371 Aug 31 12:19:42.384580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 93/171] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:42 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:42.527974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:42.539580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a8145b0b-0fa3-470b-b1ca-d7ddcddbbc97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.295638 Aug 31 12:19:42.552523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 79/172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:42 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:43.410884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:43.411568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:43.422517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:43.424609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:43.425137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:43.425922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:43.426442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:43.426934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:43.563700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:43.564293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:43.573666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:43.574170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:43.574955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:43.576648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:43.577436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:43.577887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:43.593880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:43.606755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5a1ad072-39de-4887-ab00-250cdba8e76d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1368 microversion: 2.1 time: 0.199556 Aug 31 12:19:43.607781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 94/173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:43 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:43.727786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:43.736803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f884492e-0cf9-48c2-99c4-0b6a1f85c448 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.176922 Aug 31 12:19:43.737381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 80/174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:43 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:44.632110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:44.633105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:44.642080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:44.642954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:44.659581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:44.661089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:44.661727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:44.662363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:44.759451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:44.759451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:44.765971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:44.766768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:44.767478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:44.768168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:44.768609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:44.769862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:44.881020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:44.890014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f52c281e-88a8-4617-a0ea-f7c249059adf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1559 microversion: 2.1 time: 0.263175 Aug 31 12:19:44.890934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 95/175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:44 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1559 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:44.920282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:44.920795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:44.927943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:44.928425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:44.928878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:44.929565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:44.929973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:44.930382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:45.024661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:45.033630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9bd236f-a7c6-46f8-9e89-b6180819d95e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.279199 Aug 31 12:19:45.034202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 81/176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:44 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:45.042497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-955794f1-33a6-432a-8784-9fa315eddc63 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128967 Aug 31 12:19:45.043169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 96/177] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:19:44 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:46.055340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:46.055960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:46.063414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:46.063902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:46.064771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:46.065535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:46.066051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:46.066532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:46.259722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:46.270158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e9945bb0-5d13-47eb-bb6b-4d4474cf3dc0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.218750 Aug 31 12:19:46.283614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 82/178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:46 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:47.012392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c70a1828-b624-4090-9f49-968bf34fe09c req-a18432e0-05ad-4477-b91a-1cab23117c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991ff4bb-6c07-4c69-b673-272a1e178100", "tag": "db14b681-db73-4b8e-b264-f17550194eec"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:47.023814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c70a1828-b624-4090-9f49-968bf34fe09c req-a18432e0-05ad-4477-b91a-1cab23117c25 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:47.024725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c70a1828-b624-4090-9f49-968bf34fe09c req-a18432e0-05ad-4477-b91a-1cab23117c25 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:47.025280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c70a1828-b624-4090-9f49-968bf34fe09c req-a18432e0-05ad-4477-b91a-1cab23117c25 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:47.066335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c70a1828-b624-4090-9f49-968bf34fe09c req-a18432e0-05ad-4477-b91a-1cab23117c25 service nova] Creating event network-changed:db14b681-db73-4b8e-b264-f17550194eec for instance 991ff4bb-6c07-4c69-b673-272a1e178100 on hv-cinder-85535 Aug 31 12:19:47.075790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c70a1828-b624-4090-9f49-968bf34fe09c req-a18432e0-05ad-4477-b91a-1cab23117c25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066090 Aug 31 12:19:47.077108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 97/179] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:19:47.291687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:47.293025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:47.304661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:47.305299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:47.305824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:47.306654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:47.307192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:47.307733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:47.548652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:47.568200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fd1a6d25-2a2d-4e1a-b2e2-d94c1b186fdc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.280255 Aug 31 12:19:47.571693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 83/180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:47 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:48.590660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:48.601001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:48.618539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:48.620318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:48.620864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:48.621592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:48.622371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:48.626322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:48.865725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:48.885731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1504e649-e963-4dc3-acfc-707c34904aed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.299122 Aug 31 12:19:48.887149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 98/181] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:48 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:49.911552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:49.912383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:49.921179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:49.921810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:49.922331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:49.924144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:49.924798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:49.925281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:50.162638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:50.170911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3893cef8-7e8f-46b1-ab56-e17217b77784 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.266846 Aug 31 12:19:50.171514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 84/182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:49 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:51.198880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:51.199598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:51.218924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:51.221452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:51.222280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:51.227107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:51.227829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:51.228635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:51.520924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:51.551351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d3fab320-68b9-48b5-8ef7-5846f115f5ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.358151 Aug 31 12:19:51.555352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 99/183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:51 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:52.086179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:52.086733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:52.095376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:52.095870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:52.096301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:52.097024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:52.097470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:52.102192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:52.149820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:19:52.323445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33f3a6ea-25a2-4465-8b09-c72562bbf96e tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 204 len: 0 microversion: 2.1 time: 0.240829 Aug 31 12:19:52.325486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 85/184] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:19:52 2022] DELETE /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:19:52.343887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:52.345618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:52.362260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:52.363683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:52.364569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:52.366960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:52.367883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:52.368665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:52.592840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:52.599664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:52.618130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:52.621100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:52.625258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:52.625478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:52.630111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:52.630995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:52.633396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:52.634193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-915b2978-0c0c-48d7-b066-13f52afc24c6 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1555 microversion: 2.1 time: 0.301016 Aug 31 12:19:52.634791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 100/185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:52 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:52.842854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:52.851720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-668c0642-6611-430a-9abd-32cf92b67ddc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.280243 Aug 31 12:19:52.863431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 86/186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:52 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:53.660058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:53.660785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:53.668457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:53.669161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:53.669738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:53.670760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:53.671214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:53.671658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:53.884603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:53.885378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:53.903499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:53.904112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:53.904732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:53.906647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:53.908476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:53.909399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:53.948070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:53.964847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1602d6cb-23ed-4711-9e2c-cb5aecff1317 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1555 microversion: 2.1 time: 0.312177 Aug 31 12:19:53.984312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 101/187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:53 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:54.152555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:54.162572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c057d61e-d2d6-4428-be65-06fe9d2bdb6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.281746 Aug 31 12:19:54.179486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 87/188] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:53 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:54.988971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:54.989696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:54.996384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:54.997152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:54.997930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:54.999019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:54.999709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:55.000432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:55.189674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:55.190341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:55.201673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:55.204350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:55.204896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:55.205695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:55.208098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:55.208953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:55.496585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:55.510756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6e8377d-024c-4ac2-b979-054cf3c860df tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1555 microversion: 2.1 time: 0.528144 Aug 31 12:19:55.514039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 102/189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:54 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1555 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:55.613782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:55.625994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-613ea960-c43c-4fe8-8b70-26fc738d6c09 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.440502 Aug 31 12:19:55.641566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 88/190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:55 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:56.188168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-4b082913-9a45-4291-ad28-395c4474c8ab req-c695a667-5862-42db-8439-fa8f87764197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07cb8a7-16be-4a30-95c4-38164dc5539e", "name": "network-vif-deleted", "tag": "a5dd515b-f344-466a-a4a9-792197449cc3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:19:56.205319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-4b082913-9a45-4291-ad28-395c4474c8ab req-c695a667-5862-42db-8439-fa8f87764197 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:56.206003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-4b082913-9a45-4291-ad28-395c4474c8ab req-c695a667-5862-42db-8439-fa8f87764197 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:56.207388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-4b082913-9a45-4291-ad28-395c4474c8ab req-c695a667-5862-42db-8439-fa8f87764197 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:56.251474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-4b082913-9a45-4291-ad28-395c4474c8ab req-c695a667-5862-42db-8439-fa8f87764197 service nova] Creating event network-vif-deleted:a5dd515b-f344-466a-a4a9-792197449cc3 for instance f07cb8a7-16be-4a30-95c4-38164dc5539e on hv-cinder-85535 Aug 31 12:19:56.260550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-4b082913-9a45-4291-ad28-395c4474c8ab req-c695a667-5862-42db-8439-fa8f87764197 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079754 Aug 31 12:19:56.261555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 103/191] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:19:56.536009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:56.536660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:56.547019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:56.553493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:56.555993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:56.556910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:56.557467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:56.559942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:56.649742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:56.650426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:56.662949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:56.663456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:56.664086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:56.664927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:56.665512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:56.666069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:56.690748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cace97d1adb44009acf2b7b093d1e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cb4f1fac4f4d728094c3c152c1382d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:56.711373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac88c121-9351-48a7-b622-2c5da603d6c5 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 200 len: 1346 microversion: 2.1 time: 0.180722 Aug 31 12:19:56.714767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 89/192] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:56 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 1346 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:56.903893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:56.936666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a8668b44-86a1-4515-8402-2429a76d8e88 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.289299 Aug 31 12:19:56.940846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 104/193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:56 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:19:57.741596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:57.742926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:57.762814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:57.770214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:57.771932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:57.772383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:57.785535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:57.786378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:57.786981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:57.861196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] HTTP exception thrown: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Request method failure captured: Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e HTTP/1.1 Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GmnBbJXfsCh-AzLaRGlF1gQ6QdBr5p7ZjHcat9kMW44LjEeCoAxuoOOZJyailf75-W3Ac1wSmdw6BIq26SwUhMvTesFDCGjgi43C0VnvYDswfjaPn5QZ-lMJSNNFVjvNmFiOUK73oixJGhBkuMf82rERJSpmNkc4fK1det4yt2yiU Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:19:57.886211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15cb4f1fac4f4d728094c3c152c1382d", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: cace97d1adb44009acf2b7b093d1e885 Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:57.887584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'f07cb8a7-16be-4a30-95c4-38164dc5539e'} Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:19:57.888411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:57.889992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:57.890959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Returning 404 to user: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:19:57.896202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-29c2cac2-bf1c-499b-9bf7-d17b15ce49b8 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 404 len: 111 microversion: 2.1 time: 0.160466 Aug 31 12:19:57.906752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 90/194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:57 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:19:57.959553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:57.961181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:57.974029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:57.974523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:57.979422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:57.982946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:57.998451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:58.002003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:58.169873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:58.172415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:58.208051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:58.209244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:58.209882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:58.210781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:58.211439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:58.212045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:58.228483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] HTTP exception thrown: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Request method failure captured: Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e/os-volume_attachments HTTP/1.1 Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GmnBbJXfsCh-AzLaRGlF1gQ6QdBr5p7ZjHcat9kMW44LjEeCoAxuoOOZJyailf75-W3Ac1wSmdw6BIq26SwUhMvTesFDCGjgi43C0VnvYDswfjaPn5QZ-lMJSNNFVjvNmFiOUK73oixJGhBkuMf82rERJSpmNkc4fK1det4yt2yiU Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:19:58.230799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15cb4f1fac4f4d728094c3c152c1382d", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: cace97d1adb44009acf2b7b093d1e885 Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:58.232077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'server_id': 'f07cb8a7-16be-4a30-95c4-38164dc5539e'} Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:19:58.232776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:58.233838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:19:58.236551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Returning 404 to user: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:19:58.237608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7b07ecc-c88a-4aea-8951-4be16ebc9766 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.072240 Aug 31 12:19:58.238665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 91/195] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:19:58 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:19:58.496251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:58.515711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22b9b7bf-0af8-4b36-b3f8-949991b037db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.561049 Aug 31 12:19:58.518001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 105/196] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:57 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:19:59.539691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:59.540997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:59.554495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:59.555304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:59.555896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:59.556822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:59.557240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:59.558056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:59.651288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:59.651797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:59.665477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:59.666153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:59.666670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:59.668045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:59.669208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:59.669787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:59.696766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] HTTP exception thrown: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Request method failure captured: Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e HTTP/1.1 Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GmnBbJXfsCh-AzLaRGlF1gQ6QdBr5p7ZjHcat9kMW44LjEeCoAxuoOOZJyailf75-W3Ac1wSmdw6BIq26SwUhMvTesFDCGjgi43C0VnvYDswfjaPn5QZ-lMJSNNFVjvNmFiOUK73oixJGhBkuMf82rERJSpmNkc4fK1det4yt2yiU Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:19:59.707742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15cb4f1fac4f4d728094c3c152c1382d", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: cace97d1adb44009acf2b7b093d1e885 Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.708860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'f07cb8a7-16be-4a30-95c4-38164dc5539e'} Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:19:59.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.710815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.715047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Returning 404 to user: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:19:59.716383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b540e554-92c3-43bb-80be-8ead834a0505 tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 404 len: 111 microversion: 2.1 time: 0.072556 Aug 31 12:19:59.717545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 106/197] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:19:59 2022] DELETE /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:19:59.734218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:19:59.736478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] [instance: f07cb8a7-16be-4a30-95c4-38164dc5539e] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:19:59.745184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:59.746264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:59.747089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:59.748613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:19:59.749323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:19:59.750017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:19:59.768221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] HTTP exception thrown: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Request method failure captured: Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e HTTP/1.1 Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GmnBbJXfsCh-AzLaRGlF1gQ6QdBr5p7ZjHcat9kMW44LjEeCoAxuoOOZJyailf75-W3Ac1wSmdw6BIq26SwUhMvTesFDCGjgi43C0VnvYDswfjaPn5QZ-lMJSNNFVjvNmFiOUK73oixJGhBkuMf82rERJSpmNkc4fK1det4yt2yiU Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:19:59.770433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/15cb4f1fac4f4d728094c3c152c1382d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_15cb4f1fac4f4d728094c3c152c1382d", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 15cb4f1fac4f4d728094c3c152c1382d Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-DeleteServersTestJSON-196270329 Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: cace97d1adb44009acf2b7b093d1e885 Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-DeleteServersTestJSON-196270329-project Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.771604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'f07cb8a7-16be-4a30-95c4-38164dc5539e'} Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:19:59.772227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. Aug 31 12:19:59.773230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:19:59.775943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] Returning 404 to user: Instance f07cb8a7-16be-4a30-95c4-38164dc5539e could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:19:59.777036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8bad6971-eea9-447c-a0e3-1624b708d2fa tempest-DeleteServersTestJSON-196270329 tempest-DeleteServersTestJSON-196270329-project] 10.222.0.27 "GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e" status: 404 len: 111 microversion: 2.1 time: 0.055377 Aug 31 12:19:59.781286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 107/198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:59 2022] GET /compute/v2.1/servers/f07cb8a7-16be-4a30-95c4-38164dc5539e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:19:59.800981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:19:59.814461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ffe2e501-252e-4083-ada9-99319252d4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.278834 Aug 31 12:19:59.814979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 92/199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:19:59 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:00.838159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:00.838994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:00.851206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:00.851896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:00.852324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:00.853187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:00.853784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:00.854521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:01.023201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:01.039721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5277686d-42cc-422a-9ddd-02ed2a189ab1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.206186 Aug 31 12:20:01.041323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 108/200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:00 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:02.066280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:02.067439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:02.079680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:02.085000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:02.085517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:02.086264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:02.086724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:02.087149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:02.285538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:02.294048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd399dca-c058-4eff-bdb9-2b95070bf2d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.231567 Aug 31 12:20:02.302580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 93/201] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:02 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:03.327164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:03.328704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:03.344999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:03.346131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:03.346902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:03.347875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:03.354413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:03.355261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:03.365044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:03.664887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:03.682656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ce73b2c-f0fd-4bf3-a98c-08de805e3abe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.363216 Aug 31 12:20:03.684820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 109/202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:03 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:04.705347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:04.706182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:04.718941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:04.719861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:04.721142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:04.721875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:04.727468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:04.728151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:05.374876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:05.389216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de9da2b6-a4b4-4a40-a553-433876c759bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.687696 Aug 31 12:20:05.389613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 94/203] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:04 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:06.412911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:06.413661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:06.427260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:06.428324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:06.429144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:06.430474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:06.431283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:06.432167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:06.699707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:06.719030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1ae9fe92-7b91-48da-ab3c-9ac9ce07ac33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.312017 Aug 31 12:20:06.722823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 110/204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:06 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:07.745039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:07.747648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:07.762511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:07.763952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:07.764717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:07.765619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:07.766278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:07.766925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:07.804158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:07.999283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:08.009371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25f6d732-07ed-456e-8d2b-33987b5c132c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.269439 Aug 31 12:20:08.010412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 95/205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:07 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:09.044156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:09.044897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:09.046829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=42 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:09.056542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:09.057025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:09.057511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:09.058230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:09.058781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:09.070073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:09.248779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:09.257291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41666962-49a2-4b12-9e8e-fa92d0c1d52a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.217672 Aug 31 12:20:09.272411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 111/206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:09 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:09.445045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0d0aedbe-8696-4a28-873a-07323fd5704d tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Action: 'create', calling method: .version_select at 0x7fe854f671f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1364343914", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:10.284037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:10.286150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:10.293479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:10.294207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:10.294634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:10.295496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:10.296047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:10.296602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:10.529905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:10.541864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-28e2cd13-3778-4731-a280-06a46a03cce2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.263406 Aug 31 12:20:10.557498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 112/207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:10 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:10.912534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0d0aedbe-8696-4a28-873a-07323fd5704d tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.639425 Aug 31 12:20:10.913325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 96/208] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 31 12:20:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1642 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 12:20:10.941168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e16ff8b-7089-4c98-ad21-f2b219f46cf4 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe854f78ca0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:11.002444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e16ff8b-7089-4c98-ad21-f2b219f46cf4 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.080097 Aug 31 12:20:11.011935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 113/209] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:10 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:11.571503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:11.572579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:11.585724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:11.586056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:11.587185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:11.588805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:11.589988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:11.591505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:11.763132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:11.773520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b236501b-0049-4da9-835f-6cd97c0cbe33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.207531 Aug 31 12:20:11.774098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 97/210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:11 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:12.026976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49b16833-c3b8-4bb9-b64e-8d027ab3e192 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe8550bb820>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:12.124504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49b16833-c3b8-4bb9-b64e-8d027ab3e192 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.103135 Aug 31 12:20:12.126092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 114/211] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:12 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:12.796473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:12.800720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:12.809495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:12.810458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:12.811263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:12.812425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:12.813110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:12.813892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:13.033565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:13.046754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b5bee0e-a7c7-4a12-9cfc-4c3a2619a68b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.255622 Aug 31 12:20:13.047930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 98/212] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:12 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:13.142772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c317dae-2c75-4e71-aa2e-9aabf0d9178e tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe854f67a60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:13.259839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c317dae-2c75-4e71-aa2e-9aabf0d9178e tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 354 microversion: 2.1 time: 0.121686 Aug 31 12:20:13.270010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 115/213] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:13 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:13.278787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc8f7d91-b376-4618-8642-6171e551db84 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe8551b3c10>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:13.471953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc8f7d91-b376-4618-8642-6171e551db84 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 354 microversion: 2.1 time: 0.200451 Aug 31 12:20:13.472540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 99/214] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:13 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:13.496924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-927aaab1-87b4-4b0d-95bf-0bd5c71ac88a tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe8559d1d30>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:13.601308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-927aaab1-87b4-4b0d-95bf-0bd5c71ac88a tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 202 len: 0 microversion: 2.1 time: 0.109606 Aug 31 12:20:13.606145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 116/215] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:20:13 2022] DELETE /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:20:13.616205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73ff6b41-ff68-43aa-84d6-ce294992f717 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe854f67670>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:13.721139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73ff6b41-ff68-43aa-84d6-ce294992f717 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.112338 Aug 31 12:20:13.721845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 100/216] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:13 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:14.080950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:14.083192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:14.095312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:14.096177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:14.096915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:14.098809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:14.099725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:14.100599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:14.318744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:14.336409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bbb84389-492a-405f-b2e3-d189ee19068b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.266881 Aug 31 12:20:14.338916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 117/217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:14 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:14.631527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37ac95c1-45c9-4436-a1a0-36c86ea87609 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'create', calling method: .version_select at 0x7fe854f67af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1978415969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWNAv+ptPXp2HsxFQZ+7TswrVPkfhbYnuJ/sz1QzTLkH26sydHCGo4G2bgD34aBYZHA2CiT+orwdEl6nmJdcRvLk8tKJate4sgURs6VQKY67yUJTrQfETzYazxcwJ2xgA=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:14.653058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-37ac95c1-45c9-4436-a1a0-36c86ea87609 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Getting quotas for project 2188dd8748d540ee8df3689bd8538bc8. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:20:14.657285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-37ac95c1-45c9-4436-a1a0-36c86ea87609 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Getting quotas for user 0987854672d0472ea9dfdfa2d1900a3b and project 2188dd8748d540ee8df3689bd8538bc8. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:20:14.682920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37ac95c1-45c9-4436-a1a0-36c86ea87609 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057273 Aug 31 12:20:14.683665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 101/218] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:20:14 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:14.735761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ce19651c-6e76-4727-8727-92279fc5283d tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe8550cfee0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:14.794356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ce19651c-6e76-4727-8727-92279fc5283d tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.062696 Aug 31 12:20:14.794939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 118/219] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:14 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:14.825796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1436324624", "imageRef": "56f08abc-59a4-4f6e-8416-b0534540eaa0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1978415969", "networks": [{"uuid": "5cecf6cc-9478-4f7a-b93c-79ad4bb6d7b1"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:14.933580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] validate_networks() for [('5cecf6cc-9478-4f7a-b93c-79ad4bb6d7b1', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:20:15.366114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:15.366696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:15.373700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:20:15.374473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:20:15.375282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:20:15.375923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:20:15.376281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:15.376755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:20:15.377090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:15.377674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:15.378653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:15.379361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:15.379847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:15.391004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:15.391660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:15.392244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:15.392959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:15.393655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:15.394308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:15.422336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Getting quotas for project 2188dd8748d540ee8df3689bd8538bc8. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:20:15.426860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Getting quotas for user 0987854672d0472ea9dfdfa2d1900a3b and project 2188dd8748d540ee8df3689bd8538bc8. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:20:15.443075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:20:15.445378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56f08abc-59a4-4f6e-8416-b0534540eaa0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:20:15.508954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8ef8a68-a90a-47c3-815c-a6989db5c8b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688008 Aug 31 12:20:15.518377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 102/220] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:20:15.530310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8d5ef78d-ce2d-4166-8d82-6e06a21b809f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:15.537789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8d5ef78d-ce2d-4166-8d82-6e06a21b809f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:15.661174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8d5ef78d-ce2d-4166-8d82-6e06a21b809f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:15.677415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:15.680635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8d5ef78d-ce2d-4166-8d82-6e06a21b809f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1259 microversion: 2.1 time: 0.154944 Aug 31 12:20:15.681775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 103/221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:15.690893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d348d5f-3544-4690-8b86-3c27abe32c6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.329458 Aug 31 12:20:15.703699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 119/222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:15 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:15.812814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5015eda5-59d5-4cf8-8bc2-6639fb4554da tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe855ab50d0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:15.888418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5015eda5-59d5-4cf8-8bc2-6639fb4554da tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.083114 Aug 31 12:20:15.897585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 104/223] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:15 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:16.710208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:16.711683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:16.714298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:16.715285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:16.720534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:16.721049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:16.721515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:16.722271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:16.722725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:16.723149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:16.723953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:16.724448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:16.724928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:16.725656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:16.726153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:16.726532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:16.812799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:16.820623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-79d8b3cf-da7d-4ca4-ad64-7cc9c4e7dbe4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1311 microversion: 2.1 time: 0.114434 Aug 31 12:20:16.821395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 120/224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:16.889288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:16.898316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ffa65315-dfa3-4f2c-a521-37385699b5ca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.188913 Aug 31 12:20:16.898870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 105/225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:16 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:16.911440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-78201712-93d1-4e0c-8c0b-a200d4d07066 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe8550cf820>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:16.973392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-78201712-93d1-4e0c-8c0b-a200d4d07066 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.066249 Aug 31 12:20:16.974261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 121/226] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:16 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:17.851990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:17.852992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:17.862460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:17.863252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:17.863946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:17.865108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:17.865855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:17.866520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:17.923071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:17.923936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:17.930953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:17.931637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:17.932094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:17.932879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:17.933642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:17.934217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:17.964101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:17.973000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06e674cb-51e3-45f6-9490-9c6c897e0123 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1311 microversion: 2.1 time: 0.127504 Aug 31 12:20:17.973859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 106/227] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:17.990949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-768d266c-47eb-4028-b1e9-b2b8cf0b7e08 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe855023c10>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:18.085800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-768d266c-47eb-4028-b1e9-b2b8cf0b7e08 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.101788 Aug 31 12:20:18.087185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 107/228] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:17 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:20:18.114407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:18.123160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ec03a15c-f748-4f0c-915e-9d2bdc4f16e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.206700 Aug 31 12:20:18.123812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 122/229] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:17 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:18.997218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:18.997829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:19.004445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:19.004943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:19.005378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:19.006066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:19.006529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:19.006954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:19.084721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:19.097337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf9f799c-a964-411b-8061-07058eca15f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1311 microversion: 2.1 time: 0.103930 Aug 31 12:20:19.098040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 108/230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:19.102413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-62aa0b82-43bb-4b8b-86cc-5f393c93ca83 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe85516cca0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:19.145606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:19.146238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:19.152628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:19.153032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:19.153469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:19.154164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:19.154595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:19.155028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:19.159923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-62aa0b82-43bb-4b8b-86cc-5f393c93ca83 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 200 len: 353 microversion: 2.1 time: 0.061245 Aug 31 12:20:19.164979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 123/231] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:19 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:20:19.311204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:19.319566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c1ef6262-b4d4-4a20-8401-bcdc88f29a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.178689 Aug 31 12:20:19.320147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 109/232] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:19 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:20.121116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:20.125307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:20.130837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:20.131948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:20.132464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:20.133226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:20.133687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:20.134240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:20.178100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba89f661-e712-4b32-a62e-e7baca7c2fc2 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Calling method '.version_select at 0x7fe854f67ee0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:20.241062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:20.245501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-ba89f661-e712-4b32-a62e-e7baca7c2fc2 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] HTTP exception thrown: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba89f661-e712-4b32-a62e-e7baca7c2fc2 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Request method failure captured: Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 HTTP/1.1 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1H52DPe5f8DJbQskq7XyWkXh1hZR1S6k048yQWEEDr11lbeq3Wk6-JwX2L5HGSqpT4VkYdRn-SBSdK6VVRspIP-WcTVm6xFTJHq87eHsG9D8sGgm83tlcZPNO9rWWBAE-Lh_CkSGsbmsMHWSX_FOR3yFMo9LpNadZLEyP075yKoh54 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: b4f29b97c8ec446ab236bbe84f410006 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesGetTestJSON-717880297 Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:20:20.248288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4f29b97c8ec446ab236bbe84f410006"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b4f29b97c8ec446ab236bbe84f410006"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b4f29b97c8ec446ab236bbe84f410006"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b4f29b97c8ec446ab236bbe84f410006", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesGetTestJSON-717880297 Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: b4f29b97c8ec446ab236bbe84f410006 Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesGetTestJSON-717880297 Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesGetTestJSON-717880297-project Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 0cf0baa9bb084953bb328a95ee604f10 Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesGetTestJSON-717880297-project Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'a53c8b5d-c1c5-4f7f-a55a-0ce909346e93'} Aug 31 12:20:20.249659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. (HTTP 404) (Request-ID: req-c838b5a8-df2c-46a5-82ce-8858bda159ef) Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:20:20.250524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:20:20.251835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:20:20.253074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba89f661-e712-4b32-a62e-e7baca7c2fc2 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] Returning 404 to user: Volume a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:20:20.254398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ba89f661-e712-4b32-a62e-e7baca7c2fc2 tempest-VolumesGetTestJSON-717880297 tempest-VolumesGetTestJSON-717880297-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93" status: 404 len: 109 microversion: 2.1 time: 0.079025 Aug 31 12:20:20.257005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 110/233] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:20:20 2022] GET /compute/v2.1/os-volumes/a53c8b5d-c1c5-4f7f-a55a-0ce909346e93 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:20:20.261129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-697cd03e-bba3-4c6a-a89e-c5ae3e540a38 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1311 microversion: 2.1 time: 0.146629 Aug 31 12:20:20.279453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 124/234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:20.341120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:20.342046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:20.354663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:20.355794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:20.356325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:20.357201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:20.357544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:20.358003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:20.547164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:20.555670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-75ff0705-8b6e-4234-89d6-c75bf5f37099 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.218776 Aug 31 12:20:20.556259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 111/235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:20 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:21.291090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:21.291845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:21.300298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:21.301321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:21.301974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:21.302756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:21.303293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:21.303917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:21.419594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:21.435638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0d323517-ca80-4534-93d8-c437b70f2c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1317 microversion: 2.1 time: 0.149002 Aug 31 12:20:21.439858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 125/236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:21.578843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:21.579529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:21.593051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:21.594142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:21.598154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:21.599249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:21.599795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:21.600176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:21.870110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:21.880178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22e3dec1-3c05-4b84-b596-676bef43babd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.305617 Aug 31 12:20:21.881439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 112/237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:21 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:22.461077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:22.461077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:22.469520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:22.469999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:22.470423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:22.471124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:22.471596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:22.482415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:22.724269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:22.732782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25b61554-20ce-45cf-9b49-bb081bce5449 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.276428 Aug 31 12:20:22.734684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 126/238] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:22.905710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:22.906849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:22.917030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:22.918879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:22.922303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:22.924002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:22.926034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:22.927279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:23.253017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:23.268959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-925b5a2b-7cf1-47a8-afed-b2deb82b92f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.371147 Aug 31 12:20:23.270092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 113/239] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:22 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:23.762418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:23.763037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:23.780390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:23.781412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:23.782289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:23.783401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:23.784042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:23.784672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:24.196337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:24.214266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9130972-f48f-4bf4-9052-a7528cd2b7f8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.463974 Aug 31 12:20:24.227681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 127/240] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:24.299811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:24.300781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:24.313897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:24.317745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:24.320503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:24.322035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:24.325103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:24.326413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:24.657499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:24.692502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cbe16b8c-36a9-4d1f-97a2-a69ca29c5f57 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.397485 Aug 31 12:20:24.707608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 114/241] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:24 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:25.240375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:25.241009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:25.257246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:25.258283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:25.258906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:25.260803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:25.263021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:25.263787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:25.665314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:25.680939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d8152f76-8850-4d75-9b7b-9cfce5467820 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.448253 Aug 31 12:20:25.686883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 128/242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:25.753042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:25.757125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:25.828270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:25.835212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=12 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:25.843252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:25.854368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:25.862777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:25.874102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:25.878486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:25.887682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:26.632556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:26.646181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f83503bc-544f-4841-9ac4-0cdd15c761f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1521 microversion: 2.1 time: 0.907573 Aug 31 12:20:26.646777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 115/243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:25 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1521 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:26.710026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:26.715416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:26.731729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:26.732426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:26.732969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:26.733624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:26.734078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:26.734502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:27.325098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:27.351415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8ffefd6c-6440-4ef6-9878-46a73027b76a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.636000 Aug 31 12:20:27.354240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 129/244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:27.568529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-eb873efc-4b86-4f7b-ba23-04cf8a1577c6 req-2b8593cc-8659-40e6-9c53-d3593b3c7e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:27.594284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-eb873efc-4b86-4f7b-ba23-04cf8a1577c6 req-2b8593cc-8659-40e6-9c53-d3593b3c7e7a service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:27.597970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-eb873efc-4b86-4f7b-ba23-04cf8a1577c6 req-2b8593cc-8659-40e6-9c53-d3593b3c7e7a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:27.598391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-eb873efc-4b86-4f7b-ba23-04cf8a1577c6 req-2b8593cc-8659-40e6-9c53-d3593b3c7e7a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:27.621712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-eb873efc-4b86-4f7b-ba23-04cf8a1577c6 req-2b8593cc-8659-40e6-9c53-d3593b3c7e7a service nova] Creating event network-changed:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:20:27.630219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-eb873efc-4b86-4f7b-ba23-04cf8a1577c6 req-2b8593cc-8659-40e6-9c53-d3593b3c7e7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065859 Aug 31 12:20:27.631447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 116/245] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:27.674797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:27.675715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:27.687948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:27.688501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:27.688948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:27.690899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:27.691420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:27.693710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:27.916958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:27.934275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3a63778f-c584-49a1-90d4-eccde9e45f5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1501 microversion: 2.1 time: 0.264169 Aug 31 12:20:27.936395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 130/246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:27 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1501 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:27.957966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:27.961160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:27.974757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:27.977944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:27.978663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:27.979856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:27.981207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:27.981829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:27.982887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:28.222344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:28.233634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-656687ba-fdce-48c9-b753-2be1100ceefc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1514 microversion: 2.1 time: 0.280545 Aug 31 12:20:28.234226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 117/247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:27 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:28.376070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:28.378503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:28.393396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:28.393886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:28.399312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:28.400739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:28.403438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:28.405040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:28.660325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:28.674434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3b10d48a-16e3-44fb-85c5-adf785507a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.298877 Aug 31 12:20:28.689179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 131/248] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:29.696209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:29.696822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:29.705020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:29.708223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:29.708686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:29.709426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:29.709880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:29.710303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:29.934856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:29.944273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-609f8116-cd26-4e85-8510-9537ef4be819 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.252000 Aug 31 12:20:29.945410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 118/249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:30.182175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:30.187166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:30.196015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:30.196877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:30.197549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:30.198761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:30.199450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:30.200074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:30.237015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'flavor' on Instance uuid 4b2c92aa-79af-4b50-93ca-50d2482f95d9 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:20:30.270157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:30.400756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d61db44d-28b1-4c37-96f0-96e95929cfd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/action" status: 200 len: 32 microversion: 2.1 time: 0.223603 Aug 31 12:20:30.402123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 132/250] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:20:30 2022] POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:20:30.412036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:30.413208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:30.420412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:30.420982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:30.421718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:30.422405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:30.423050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:30.423497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:30.653804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:30.662602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8803fad3-2105-401d-9f68-d3a523253e61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.254599 Aug 31 12:20:30.663218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 119/251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:30 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:30.971300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:30.972544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:30.986251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:30.987157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:30.987906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:30.989310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:30.990024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:30.990925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:31.269325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:31.280760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6dc5c38-5e29-47f4-92d3-6e09cdf997e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.318642 Aug 31 12:20:31.281974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 133/252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:31.686312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:31.688595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:31.706171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:31.707362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:31.707953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:31.708846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:31.709297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:31.709722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:31.948822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:31.961601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-489a233f-4306-425d-980d-a6f52226c790 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.279753 Aug 31 12:20:31.976057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 120/253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:31 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:32.309158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:32.316225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:32.336705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:32.341461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:32.342164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:32.342898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:32.343374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:32.344009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:32.581017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:32.595964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e971c38a-62b5-4998-8e7c-6901d9025d80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.296503 Aug 31 12:20:32.596552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 134/254] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:32.985972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:32.987474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:32.993944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:32.994526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:32.995256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:32.996092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:32.996636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:32.997293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:33.019167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:33.152796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:33.161370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-30ac2d94-a37c-417d-b42c-86b90fd8e69e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.179045 Aug 31 12:20:33.161957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 121/255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:32 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:33.620032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:33.621611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:33.629096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:33.629621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:33.630122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:33.630825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:33.631348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:33.631707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:33.800501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:33.810440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c657a0ae-4899-4f77-a641-e4a8be6821f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.193887 Aug 31 12:20:33.812822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 135/256] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:34.183313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:34.183972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:34.197955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:34.198897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:34.199390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:34.200120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:34.202836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:34.205334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:34.529420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:34.541522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cef8bcb3-ff91-49a9-a333-f05466dbfe8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.361872 Aug 31 12:20:34.542727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 122/257] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:34 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:34.835049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:34.836221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:34.855998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:34.856550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:34.857734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:34.860007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:34.860715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:34.864074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:35.055388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:35.065399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-89b6b82b-5f99-49ec-aae4-b27c0467f930 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.235033 Aug 31 12:20:35.078683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 136/258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:35.502209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:35.503002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:35.513090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:35.513922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:35.514735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:35.516175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:35.517193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:35.518106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:35.560222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3de7c0d-5761-42a5-86e1-5ded2587c5b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/ips" status: 200 len: 150 microversion: 2.20 time: 0.069751 Aug 31 12:20:35.560983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 123/259] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Aug 31 12:20:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/ips => generated 150 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:20:35.575434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:35.577017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:35.592298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:35.593188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:35.594261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:35.596156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:35.597481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:35.598682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:35.839519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:35.855637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25e6e387-681e-4c7d-9016-f05475092284 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.287968 Aug 31 12:20:35.873058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 137/260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:35 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:36.101947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:36.102765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:36.116519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:36.117946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:36.118520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:36.120632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:36.122266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:36.124342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:36.454440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:36.468572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2c29dd3-6a7a-4d84-a9b2-c9275d770187 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.370674 Aug 31 12:20:36.469194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 124/261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:36.872493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:36.872926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:36.880536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:36.881060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:36.881444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:36.882141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:36.882583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:36.883355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:37.032493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:37.040794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2438fc4-88ac-4823-a98f-6b19abfb905d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.173252 Aug 31 12:20:37.041552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 138/262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:36 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:37.490425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:37.491040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:37.501313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:37.501937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:37.502376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:37.503082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:37.503583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:37.504036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:37.704033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:37.723841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0dd5f11b-9758-4bc8-95b4-85686f76e81d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.229767 Aug 31 12:20:37.727617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 125/263] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:38.062084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:38.062738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:38.068957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.069445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.069904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.070576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.071383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.096259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.320795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:38.330734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a9324f1b-af1f-49c2-ab5b-8503b1d48ca2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.272252 Aug 31 12:20:38.331769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 139/264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:38 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:38.646752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:38.647340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:38.654685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.655174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.655636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.657085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.658090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.658715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.687343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lazy-loading 'flavor' on Instance uuid 6cd7c10d-e093-4252-a8a2-f47366d712be {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:20:38.740753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:38.741504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:38.749617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.750102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.750581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.751332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.751942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.752359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.913648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:38.919000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-139c122d-0c38-40b9-bda3-f76fbc22519f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/action" status: 202 len: 0 microversion: 2.20 time: 0.277440 Aug 31 12:20:38.922345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cee21f10-5500-46b9-8126-1c1521a4baa9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.185959 Aug 31 12:20:38.923080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 140/265] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:38.936096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 126/266] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 31 12:20:38 2022] POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:20:38.936096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:38.936096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:38.939486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.939894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.940321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:38.941037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:38.941477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:38.941895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:39.091473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:39.100498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:39.102078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:39.103531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d27d56b-47aa-4bbe-a01e-1f5d432d10f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.178176 Aug 31 12:20:39.104202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 127/267] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:39.285863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-2f73f464-c7fd-4b5b-93ed-d1b4d2bf1785 req-41c3788f-52a8-4a21-aa26-95486f1ed0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "name": "network-vif-plugged", "status": "completed", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:39.296378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=46 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:39.306046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2f73f464-c7fd-4b5b-93ed-d1b4d2bf1785 req-41c3788f-52a8-4a21-aa26-95486f1ed0c0 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:39.306525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2f73f464-c7fd-4b5b-93ed-d1b4d2bf1785 req-41c3788f-52a8-4a21-aa26-95486f1ed0c0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:39.307003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2f73f464-c7fd-4b5b-93ed-d1b4d2bf1785 req-41c3788f-52a8-4a21-aa26-95486f1ed0c0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:39.325217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-2f73f464-c7fd-4b5b-93ed-d1b4d2bf1785 req-41c3788f-52a8-4a21-aa26-95486f1ed0c0 service nova] Creating event network-vif-plugged:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:20:39.330848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-2f73f464-c7fd-4b5b-93ed-d1b4d2bf1785 req-41c3788f-52a8-4a21-aa26-95486f1ed0c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055502 Aug 31 12:20:39.332095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 141/268] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:39.353582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:39.354570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:39.361023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:39.361587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:39.362276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:39.362982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:39.363516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:39.364200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:39.633323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:39.645147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a937e791-7be0-4eff-806b-8959535cc588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.295453 Aug 31 12:20:39.658876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 128/269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:39 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:39.944429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:39.945284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:39.952619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:39.953246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:39.953771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:39.954539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:39.955057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:39.955583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:40.121315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:40.127107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:40.127756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:40.130519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-be2566fa-a852-4f56-8b9c-48f6ae9feb3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1359 microversion: 2.1 time: 0.190431 Aug 31 12:20:40.133078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 142/270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:40.135279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:40.135763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:40.136185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:40.137076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:40.137628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:40.138117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:40.317812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:40.331015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:40.333137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:40.335319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7e65c51a-2eb6-431d-b514-503da8638d65 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.212766 Aug 31 12:20:40.336862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 129/271] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:40.668230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:40.669131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:40.684354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:40.684846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:40.685496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:40.686373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:40.686978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:40.688199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.161755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:41.162933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:41.174961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.175898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.176686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.177755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.184318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.184911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.187428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.200104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-861f3c38-73e2-4001-8c93-692e4ca949b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.537186 Aug 31 12:20:41.201856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 143/272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:40 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:41.359568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:41.360234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:41.368919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.370101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.371045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.372115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.373264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.374703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.527162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.542257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6038f22a-1d75-4a1f-9978-8ae820704966 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1549 microversion: 2.1 time: 0.383648 Aug 31 12:20:41.543770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 130/273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1549 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:41.569427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:41.570984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:41.578276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.578941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.579825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.580995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.582222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.583081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.780997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.798563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.800463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.805844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d49716e4-fca6-4d56-aeb4-a94476daed8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.450724 Aug 31 12:20:41.807658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 144/274] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:41.898551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.910917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-313edafa-a499-42f4-bc23-5bc430d45bcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1549 microversion: 2.1 time: 0.345978 Aug 31 12:20:41.911843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 131/275] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1549 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:41.933058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:41.938265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:41.938906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Searching by: {'deleted': False, 'project_id': '2188dd8748d540ee8df3689bd8538bc8'} {{(pid=120573) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 12:20:41.947578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.948326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.949046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:41.949432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:41.950026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:41.950592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.086349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.multi_cell_list [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120573) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 12:20:42.210679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f6815d0-cc87-4c07-bfd1-10b6a3706c85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.282970 Aug 31 12:20:42.217896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 145/276] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Aug 31 12:20:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:42.223618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:42.225158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:42.232868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.233791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.234308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:42.234942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:42.235132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.236422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.237952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.238609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.259696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.260642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.261310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.262084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.262549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.263172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.591097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:42.604810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4bd40e46-b298-4dd1-a00b-339169ad413f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1549 microversion: 2.1 time: 0.383502 Aug 31 12:20:42.621841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 132/277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1549 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:42.639016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:42.641612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:42.656825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:42.666944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.667727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.668446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b7b79ae-4af7-4f63-9c79-a69ee3e95f80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.441785 Aug 31 12:20:42.669081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.672013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 146/278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:42 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:42.672621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.673254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.674049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.711637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c98d8a6d-e674-4a05-beac-b145a92d7108 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/ips" status: 200 len: 151 microversion: 2.1 time: 0.088588 Aug 31 12:20:42.712504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 133/279] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:20:42 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:42.830089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:42.830784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:42.837637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.838471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.839142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:42.840182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:42.840843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:42.841599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:43.184322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:43.187958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:43.199769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:43.204365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:43.206966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-15c83763-0df9-4d39-81d1-aad34b904bce tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.381064 Aug 31 12:20:43.208011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 147/280] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:20:43.694232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:43.695585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:43.702207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:43.702972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:43.703630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:43.704588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:43.705295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:43.705963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:44.056845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:44.066244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-56f27855-36cb-4a37-beed-3178da0270d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.377221 Aug 31 12:20:44.075780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 134/281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:43 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:44.237190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:44.239464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:44.249496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:44.250017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:44.250452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:44.251155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:44.251747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:44.252566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:44.479771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:44.490291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:44.492056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:44.497492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b137ca8-c053-4057-910d-a3b8fa77c7d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.266814 Aug 31 12:20:44.498181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 148/282] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:44.723292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "856d9cff-7622-4c18-9008-e074f71c27b8"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:44.726178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:44.734319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:44.735259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:44.735864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:44.736791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:44.737579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:44.738433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:44.834897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "487ee81b-f8c3-407a-94ff-cfb9399ce87d"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:44.837667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:44.850992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:44.855956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:44.856433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:44.863669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:44.863669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:44.863669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:45.152736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:45.192492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6688b8e3-967e-44f6-a492-8da191041da7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473529 Aug 31 12:20:45.193551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 135/283] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:20:44 2022] POST /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:45.200834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:45.202734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:45.214286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:45.215431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:45.216331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:45.217786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:45.218778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:45.219560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:45.234899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9102c834-8c02-4cd8-8a2c-0e4dcf845866 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405583 Aug 31 12:20:45.236671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 149/284] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:20:44 2022] POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:20:45.416673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:45.428480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-71c630d7-a6a4-4495-9d0c-7c8e6c23a7ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.232718 Aug 31 12:20:45.429419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 136/285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:45 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:45.523376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:45.524075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:45.533075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:45.533655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:45.533973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:45.534668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:45.535423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:45.535761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:45.705764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:45.722108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:45.723590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:45.725606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5530e0d-75f2-44a7-a9b1-895c1a9a82d3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.207195 Aug 31 12:20:45.726992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 150/286] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:46.454199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:46.454968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:46.467328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:46.468031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:46.469050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:46.471771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:46.472219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:46.472695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:46.657573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:46.665453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a7e753a-9b89-41e9-81a9-fc86921bed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.215482 Aug 31 12:20:46.679898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 137/287] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:46 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:46.752438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:46.753673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:46.760212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:46.760815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:46.761470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:46.762385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:46.762860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:46.763473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:46.935942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:46.946341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:46.949128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:46.950715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d0173f4-7248-46c1-ae81-bbc5a2191529 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.202631 Aug 31 12:20:46.951628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 151/288] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:47.689734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:47.690890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:47.699011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:47.699528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:47.700720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:47.701772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:47.702539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:47.704263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:47.868679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:47.877094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e45338e6-f5fe-4c37-9848-c9f9552be06a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.191497 Aug 31 12:20:47.878006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 138/289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:47 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:47.982216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:47.984088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:47.991798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:47.992769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:47.993343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:47.994394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:47.995208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:47.995897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:48.218491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:48.228238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:48.230528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:48.232194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d62dc8e-a9df-49fc-b409-7d661b75347c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.256537 Aug 31 12:20:48.247677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 152/290] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:48.900384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:48.901621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:48.912129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:48.913529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:48.914530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:48.916067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:48.916801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:48.917451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:49.082019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:49.090902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c2869dbc-4504-400b-bfc2-46f278d7dcde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.195300 Aug 31 12:20:49.091510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 139/291] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:48 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:49.257562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:49.258197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:49.266039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:49.266502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:49.266953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:49.267708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:49.268158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:49.268554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:49.432487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:49.441707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:49.443299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:49.444526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f02c5cd-52a0-4b1d-8a09-1bfe980faa61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.191859 Aug 31 12:20:49.445083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 153/292] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:50.112775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:50.113393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:50.120377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:50.120872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:50.121308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:50.122007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:50.122456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:50.122897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:50.322725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:50.331474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb2f63d7-3f63-43c2-b81b-3bf90a473b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.222758 Aug 31 12:20:50.332319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 140/293] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:50 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:50.470729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:50.471294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:50.478783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:50.479377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:50.479895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:50.480713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:50.481342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:50.482202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:50.697479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:50.706676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:50.708079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:50.709290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d9853278-3319-4ea2-acb1-01b8dcc974e4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.244314 Aug 31 12:20:50.709839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 154/294] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:51.353642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:51.354267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:51.361304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:51.361935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:51.362362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:51.363052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:51.363529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:51.364046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:51.524172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:51.532222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc30637e-0a4f-4037-843e-74096af76237 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.182703 Aug 31 12:20:51.532956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 141/295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:51 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:51.736601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:51.737259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:51.746883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:51.747419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:51.747847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:51.748551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:51.748987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:51.749416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:51.888757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:51.902224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:51.903704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:51.904884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-81c42adc-1703-4109-a79a-9041f8a52511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.174311 Aug 31 12:20:51.905652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 155/296] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:52.553991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:52.554544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:52.562882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:52.563404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:52.563875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:52.564613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:52.565402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:52.566933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:52.710569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:52.720051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-709fd07b-cb77-44fb-a015-37cc3c87650a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.169844 Aug 31 12:20:52.720656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 142/297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:52 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:52.929594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:52.930173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:52.932236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:52.938322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:52.938750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:52.939177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:52.939859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:52.940312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:52.940727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:53.074430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:53.085798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:53.087905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:53.089639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-465dfdbf-7ebe-48a2-ae0b-ffaedbe5ef81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.163776 Aug 31 12:20:53.090477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 156/298] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:53.746712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:53.747326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:53.754429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:53.754984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:53.755458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:53.756232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:53.756679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:53.757099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:53.920086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:53.929999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-23d602ba-b767-473f-a2fd-ffde3945d1cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.187382 Aug 31 12:20:53.940179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 143/299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:53 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:54.113590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:54.114156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:54.121662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:54.122154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:54.122580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:54.123335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:54.123790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:54.124212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:54.269238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:54.279002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:54.280475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:54.281843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-53b21e16-509c-4ab4-b86b-b8f92575b3fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.172381 Aug 31 12:20:54.282424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 157/300] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:54.976225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:54.976944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:54.984129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:54.984918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:54.985357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:54.986050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:54.986495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:54.986914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:55.152656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:55.165250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6850b052-fe1d-456e-ad68-dd462c5c006d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.194598 Aug 31 12:20:55.166228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 144/301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:54 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:55.306659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:55.307492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:55.314470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:55.315013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:55.315497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:55.316192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:55.316629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:55.317057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:55.465401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:55.480718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:55.483978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:55.485969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f7f5573b-ebaa-494f-a9b5-38cd31378c42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.183548 Aug 31 12:20:55.486970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 158/302] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:20:56.190628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:56.196085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:56.198997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:56.199596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:56.200157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:56.200994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:56.201495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:56.202010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:56.369390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:56.380431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1c9f2b4-eab2-4fd7-bc09-18a44f64aa31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.194110 Aug 31 12:20:56.381026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 145/303] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:56 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:56.513039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:56.513708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:56.520968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:56.521457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:56.521909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:56.522618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:56.523069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:56.523515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:56.682947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:56.692149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:56.693598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:56.694763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-940cc6b3-3e61-4ea5-ab40-e1482bd23642 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.186823 Aug 31 12:20:56.695334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 159/304] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:20:57.410541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:57.412092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:57.419949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:57.420885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:57.421516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:57.422224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:57.422679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:57.423097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:57.425732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:57.426738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:57.435777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:57.436386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:57.436958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:57.437790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:57.438355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:57.439130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:57.658048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:57.671149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-08948d31-8a7c-4f09-a912-48ff38bdc08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1595 microversion: 2.1 time: 0.248730 Aug 31 12:20:57.673878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 160/305] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1595 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:57.721838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:57.722803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:57.729779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:57.730264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:57.730693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:57.731430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:57.731881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:57.732646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:57.739801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:57.749497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5016f28d-1eae-45c2-9fa8-3622207cbcaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.348237 Aug 31 12:20:57.750074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 146/306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:57 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:57.895072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:57.906647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:57.908131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:57.909311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-11e3e15e-2e8b-46d1-a677-18dd988bf687 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.194121 Aug 31 12:20:57.910344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 161/307] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:20:57.996216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-549547307", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "networks": [{"uuid": "e2cce7b5-4996-4066-9026-8abd05d477be"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:58.033548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-788582323", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:58.065243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] validate_networks() for [('e2cce7b5-4996-4066-9026-8abd05d477be', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:20:58.102012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] validate_networks() for None {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:20:58.590950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:20:58.591575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:20:58.592138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:20:58.592609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:20:58.593079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:20:58.603462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:58.604381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:58.605185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:58.606668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:58.607336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:58.607761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:58.625990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Getting quotas for project 90897266779e40028dc2be9301efff53. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:20:58.630531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Getting quotas for user 7d60bea32ca4476d84d00d9ff95f3516 and project 90897266779e40028dc2be9301efff53. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:20:58.642826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:20:58.645213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:20:58.705782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:20:58.713603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdaea9a9-f2f5-44b7-a0e4-62cf58bc1e76 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689139 Aug 31 12:20:58.714532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:20:58.715004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 162/308] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:20:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 12:20:58.715561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:20:58.716159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:20:58.718272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:20:58.722051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=62 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:58.726705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-32405ec6-b92c-4db1-b373-3b70a9f119b1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:58.727502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-32405ec6-b92c-4db1-b373-3b70a9f119b1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:58.738684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:58.741177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:58.741828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:58.743552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:58.744496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:58.745315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:58.765521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Getting quotas for project a34eb3e0aba44efb8ddafedd89df4060. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:20:58.771177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Getting quotas for user 37a3870e9df04d7795a649a21b722801 and project a34eb3e0aba44efb8ddafedd89df4060. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:20:58.783512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-32405ec6-b92c-4db1-b373-3b70a9f119b1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:58.785211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:20:58.790707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:20:58.791534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-32405ec6-b92c-4db1-b373-3b70a9f119b1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1214 microversion: 2.1 time: 0.068747 Aug 31 12:20:58.804974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 163/309] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:58 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:58.811879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:58.812563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:58.820771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:58.821673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:58.822720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:58.823757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:58.824365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:58.825637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:58.855969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8b52725-ce51-4560-af22-add56d90b53e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864011 Aug 31 12:20:58.857047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 147/310] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:20:58.870257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-366df4cd-5342-4e3f-9182-7e8e70890fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:58.872873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-366df4cd-5342-4e3f-9182-7e8e70890fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:58.994470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-366df4cd-5342-4e3f-9182-7e8e70890fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:59.021245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-366df4cd-5342-4e3f-9182-7e8e70890fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1218 microversion: 2.1 time: 0.151720 Aug 31 12:20:59.022477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 148/311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:58 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:20:59.029128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:59.030124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:59.040400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:59.041758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:59.042398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:59.044401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:59.045574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:59.046252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:59.126691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:59.131134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:59.138846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1e491e9f-0a35-4b07-97c8-e76de11182d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.332434 Aug 31 12:20:59.140054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 164/312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:58 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:59.272930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:59.283960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:59.285560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:59.287066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b9b535b-4855-425d-9e5d-71959f73af22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.262737 Aug 31 12:20:59.287730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 149/313] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:20:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:20:59.815280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:20:59.815835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:20:59.824592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:59.825085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:59.825514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:59.826201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:59.826647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:59.827075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:59.896135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:20:59.904104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-24f8fbfc-fc0c-47fc-bf0a-b7423cafdf1f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1218 microversion: 2.1 time: 0.093037 Aug 31 12:20:59.904874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 165/314] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:20:59 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:20:59.973386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-cccc2b7a-96ab-4f3b-8a1f-82653e45f0a9 req-955fbcf8-0295-4252-92d0-b336b9e98eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:20:59.985132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cccc2b7a-96ab-4f3b-8a1f-82653e45f0a9 req-955fbcf8-0295-4252-92d0-b336b9e98eec service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:20:59.985601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cccc2b7a-96ab-4f3b-8a1f-82653e45f0a9 req-955fbcf8-0295-4252-92d0-b336b9e98eec service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:20:59.986204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cccc2b7a-96ab-4f3b-8a1f-82653e45f0a9 req-955fbcf8-0295-4252-92d0-b336b9e98eec service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:20:59.999392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-cccc2b7a-96ab-4f3b-8a1f-82653e45f0a9 req-955fbcf8-0295-4252-92d0-b336b9e98eec service nova] Creating event network-changed:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:21:00.005073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-cccc2b7a-96ab-4f3b-8a1f-82653e45f0a9 req-955fbcf8-0295-4252-92d0-b336b9e98eec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035453 Aug 31 12:21:00.005672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 150/315] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:00.042885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:00.043548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:00.051827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.052304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.052735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.053503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.054060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.054655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.137275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:00.159263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9cea028e-aeca-4564-867f-528e3080e43f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1222 microversion: 2.1 time: 0.108066 Aug 31 12:21:00.159263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 166/316] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:00 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:00.174975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:00.176888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:00.188634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.189281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.189869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.190709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.191467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.192166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.312938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:00.313837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:00.324686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.325982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.327512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.330333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.334194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.335271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.373019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:00.385390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0765ace-19da-4a93-9765-5c17c7f84dd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.225201 Aug 31 12:21:00.386921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 151/317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:00 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:00.535620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:00.545011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:00.546805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:00.548028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d2f4e58-abcb-4878-b87c-3e3acdd100d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.239085 Aug 31 12:21:00.548583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 167/318] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:00.928703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:00.929396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:00.939968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.940696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.941301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:00.942815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:00.943558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:00.944208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.111091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:01.130969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-814533da-5f22-4c33-a176-508f7aec9926 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1210 microversion: 2.1 time: 0.209000 Aug 31 12:21:01.131594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 152/319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:00 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:01.176819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:01.178013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:01.186741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.187267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.187267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.187986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.188426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.189027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.283086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:01.296896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30f7ca6a-e1f7-4541-b904-d27112929994 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1270 microversion: 2.1 time: 0.125679 Aug 31 12:21:01.297881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 168/320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:01 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:01.418589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:01.419563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:01.429878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.435982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.437613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.438999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.441274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.442322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.529202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1790011976"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:01.530021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:01.537812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.538743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.539195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.540628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.541101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.541594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.779047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:01.787869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bd118081-e1dc-4dbb-b4e7-94f20a012616 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 0.379824 Aug 31 12:21:01.790081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 153/321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:01 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:01.796921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.network.security_group_api [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Adding security group c61c4dc4-4cbe-41f0-adcb-db31f45833e3 to port e019afe6-6742-49d8-a13f-9401fa9407a3 Aug 31 12:21:01.801536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:01.802220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:01.817790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.818633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.819675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.821041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:01.822170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:01.822909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:01.909291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:02.643048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:02.669251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:02.675781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:02.677637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a4c512f5-5ee3-4f09-80b0-11be717a15cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.885633 Aug 31 12:21:02.720711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 154/322] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:02.749456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:02.754825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:02.781421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:02.782074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:02.782554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:02.783897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:02.787767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:02.788217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:02.930645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:02.939764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab564c27-8026-4a93-ad27-6b25b2616cac tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1266 microversion: 2.1 time: 0.211267 Aug 31 12:21:02.954565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 155/323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:02 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:02.960218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:02.960742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:02.968691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:02.969237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:02.969678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:02.970543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:02.971006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:02.971581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.070142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:03.079496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-95bb8371-b9c1-4466-a46d-90384ddf5af1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1270 microversion: 2.1 time: 0.123606 Aug 31 12:21:03.080339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 156/324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:02 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:03.085739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:03.086345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:03.094652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.095548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.096051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.096909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.097423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.097885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.124975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b07d974c-2313-4bf7-a8ee-dffe8d134dca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action" status: 202 len: 0 microversion: 2.1 time: 1.602234 Aug 31 12:21:03.127994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 169/325] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:21:01 2022] POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action => generated 0 bytes in 1606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:21:03.148724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:03.150074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:03.156513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.159888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.160953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.162045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.167022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.168004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.505384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:03.520508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a8397014-b9c3-4642-a128-c7d9e5194681 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1500 microversion: 2.1 time: 0.438736 Aug 31 12:21:03.521094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 157/326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:03 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1500 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:03.526486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-5ecc6a2b-a014-4a9d-bb01-09edde5cd327 req-ef33b9c1-fb25-4979-8dd0-99a6651a3d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:03.559646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5ecc6a2b-a014-4a9d-bb01-09edde5cd327 req-ef33b9c1-fb25-4979-8dd0-99a6651a3d69 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.564167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5ecc6a2b-a014-4a9d-bb01-09edde5cd327 req-ef33b9c1-fb25-4979-8dd0-99a6651a3d69 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.565035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5ecc6a2b-a014-4a9d-bb01-09edde5cd327 req-ef33b9c1-fb25-4979-8dd0-99a6651a3d69 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.620425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-5ecc6a2b-a014-4a9d-bb01-09edde5cd327 req-ef33b9c1-fb25-4979-8dd0-99a6651a3d69 service nova] Creating event network-changed:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:21:03.640122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-5ecc6a2b-a014-4a9d-bb01-09edde5cd327 req-ef33b9c1-fb25-4979-8dd0-99a6651a3d69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117440 Aug 31 12:21:03.646009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 158/327] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:03.660693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfd4a9b5-7112-4b88-ae7f-af4049cfe5b8"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:03.690891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:03.720253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:03.764082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.764916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.765548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.768304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.770491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.774746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.800408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-749c5f58-0ddf-4f7d-a2b4-4ec12151f06e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1761 microversion: 2.1 time: 0.668237 Aug 31 12:21:03.802981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 170/328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1761 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:03.811377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:03.812080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:03.838308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.838799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.839246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.839963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.840413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.841384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.855798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] HTTP exception thrown: Cannot 'attach_volume' instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 while it is in vm_state rescued Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Request method failure captured: Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/os-volume_attachments HTTP/1.1 Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 74 Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpCnfPhE60MGW35xsKbWQymLH2VKfbkI8riuoyoErKnTaGSCbSjxJHTp3nA14pCNszMnYLak-gAikA7fQD08O00APmFXBcZXarjQNMSf5drcY4PF0Y3QT7FucqIAXv_g4UWE6nQ-UpiHVrwvs357GiMOlSO1u_7YlmdlMt4jfbLfE Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:21:03.857738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8687bcf9d2a242b5af329bce4a8ad6d9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: a8320be5e9644b6699ac526913e109eb Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "cfd4a9b5-7112-4b88-ae7f-af4049cfe5b8"}} Aug 31 12:21:03.859127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Cannot 'attach_volume' instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 while it is in vm_state rescued Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '4b2c92aa-79af-4b50-93ca-50d2482f95d9', 'body': {'volumeAttachment': {'volumeId': 'cfd4a9b5-7112-4b88-ae7f-af4049cfe5b8'}}} Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:21:03.859999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 while it is in vm_state rescued Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:21:03.861575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:21:03.865665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:21:03.865665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:21:03.865665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 while it is in vm_state rescued Aug 31 12:21:03.865665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:03.875036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Returning 409 to user: Cannot 'attach_volume' instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 while it is in vm_state rescued {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:21:03.877973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5021c60d-6ca0-4c58-a4ee-7ad655b4c9c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.229243 Aug 31 12:21:03.880078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 159/329] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:21:03 2022] POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/os-volume_attachments => generated 152 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 12:21:03.895742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:03.896724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:03.911141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.919533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.923511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:03.924817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:03.925552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:03.926219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.079569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f5cdf30-66d4-422e-a936-183900404063 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/action" status: 202 len: 0 microversion: 2.1 time: 0.193705 Aug 31 12:21:04.079726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 160/330] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:21:03 2022] POST /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:21:04.090023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:04.092529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:04.103944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:04.104615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:04.105242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.107615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:04.108576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:04.109168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.245553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:04.261074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-82c27c5a-fac6-4b55-b06c-d7ba1189932f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1272 microversion: 2.1 time: 0.176738 Aug 31 12:21:04.261998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 161/331] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:04 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:04.277513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:04.277513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:04.300066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:04.300600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:04.301022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.301754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:04.302254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:04.302633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.764852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:04.778780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:04.780585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:04.782187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6434b8dc-032d-46e7-a2d4-48fc33d55cd6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.975323 Aug 31 12:21:04.783724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 171/332] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:04.798231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:04.804558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:04.810619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:04.816663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:04.817155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:04.817590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.818297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:04.818746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:04.819163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:04.832007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bec70ae7-6905-4556-bf24-ecddf1549603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1508 microversion: 2.1 time: 0.568455 Aug 31 12:21:04.833048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 162/333] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:04 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1508 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:04.970333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:04.981370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-01d934ea-2c16-4cdd-b6b1-c8f1ffc98e72 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1276 microversion: 2.1 time: 0.196294 Aug 31 12:21:05.003341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 172/334] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:04 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:05.285571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:05.285903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:05.297771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:05.298640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:05.299929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:05.301387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:05.303038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:05.304254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:05.465444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:05.474983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b5ab857-918e-4be9-ae3f-b0c30a0bde47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1272 microversion: 2.1 time: 0.193535 Aug 31 12:21:05.489016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 163/335] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:05 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:05.812091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:05.813503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:05.824745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:05.825271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:05.826087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:05.826996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:05.827633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:05.828214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:05.856913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:05.857555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:05.875088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:05.877218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:05.880437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:05.881734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:05.884154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:05.887321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:06.190543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:06.202631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:06.210770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:06.211567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b03e4e3-249b-4de0-bcdc-c19858fbfb36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1508 microversion: 2.1 time: 0.360855 Aug 31 12:21:06.219379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 164/336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:05 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1508 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:06.219614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:06.219614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-328c0239-1165-4877-b860-b037ae2d8c71 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.408992 Aug 31 12:21:06.223932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:06.225301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:06.234015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:06.234814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:06.235450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:06.238026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 173/337] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:06.241682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:06.246306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:06.250297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:06.424107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-20336d8c-8573-4879-810d-b7b077d3a44d req-dae1ace5-20a4-4ac4-b9a0-b15568fccd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cc2e2-509e-4bf7-a56f-28002021cda8", "tag": "f298c8bf-7f0e-415b-9af7-b4dc0033bf36"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:06.426698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:06.434911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-20336d8c-8573-4879-810d-b7b077d3a44d req-dae1ace5-20a4-4ac4-b9a0-b15568fccd60 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:06.435928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-20336d8c-8573-4879-810d-b7b077d3a44d req-dae1ace5-20a4-4ac4-b9a0-b15568fccd60 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:06.436794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-20336d8c-8573-4879-810d-b7b077d3a44d req-dae1ace5-20a4-4ac4-b9a0-b15568fccd60 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:06.440793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-43c19629-fe0d-405f-85e9-3dc8578a2743 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.225116 Aug 31 12:21:06.443717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 165/338] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:06 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:06.475402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-20336d8c-8573-4879-810d-b7b077d3a44d req-dae1ace5-20a4-4ac4-b9a0-b15568fccd60 service nova] Creating event network-changed:f298c8bf-7f0e-415b-9af7-b4dc0033bf36 for instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 on hv-cinder-85535 Aug 31 12:21:06.485511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-20336d8c-8573-4879-810d-b7b077d3a44d req-dae1ace5-20a4-4ac4-b9a0-b15568fccd60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064756 Aug 31 12:21:06.487710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 174/339] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:21:06.500552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:06.501290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:06.517273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:06.517771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:06.518224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:06.520256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:06.520724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:06.521229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:06.718350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:06.723640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08930d3d-b9b4-45b6-bca2-4b4cbeaba691 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.227399 Aug 31 12:21:06.724220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 166/340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:06 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:07.234452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:07.235175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:07.242848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.243379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.243818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.244536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.245097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.245678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.256682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:07.257467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:07.265444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.266216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.266802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.267728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.268351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.268927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.572801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:07.582244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:07.583753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:07.585169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c5f0661-ace2-4082-aec2-3d5e9a11c09e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1721 microversion: 2.20 time: 0.332792 Aug 31 12:21:07.585953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 167/341] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:07.591108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:07.591743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:07.598549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.599179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.599648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.600353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.600797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.601339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.651257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:07.661074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9b4a65b7-344e-4935-872e-7491d6f82e48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1508 microversion: 2.1 time: 0.430420 Aug 31 12:21:07.676564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 175/342] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:07 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1508 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:07.749877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:07.751961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:07.762599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.765132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.766436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:07.768051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:07.768864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:07.770282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:08.053128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:08.066461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a99d3af5-be6e-4627-b8b7-4ce4a635dd51 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.477912 Aug 31 12:21:08.071772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 168/343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:07 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:08.536943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:08.549935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26019f87-e343-491d-9036-00eed9e34976 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.808782 Aug 31 12:21:08.550828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 176/344] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:07 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:08.616761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:08.617565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:08.623984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:08.624837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:08.625208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:08.625937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:08.626552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:08.627129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:08.682635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:08.683280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:08.689125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:08.694160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:08.695083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:08.696652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:08.697636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:08.698130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:08.700825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:08.753717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:08.788642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:09.001086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=8 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:09.069514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:09.090008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:09.092306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:09.094008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5f30ebe1-eecf-42ce-9bda-4579e6838db9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1742 microversion: 2.20 time: 0.481613 Aug 31 12:21:09.095519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 169/345] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1742 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:09.136033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:09.137201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:09.148204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:09.148918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:09.149535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:09.151464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:09.151926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:09.152453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:09.202327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:09.212487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ab138250-c4e1-4c19-83ad-24951e642115 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1514 microversion: 2.1 time: 0.534158 Aug 31 12:21:09.214253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 177/346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:08 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1514 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:09.391510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-3cf04d0e-6744-4436-8b54-b1747c33b381 req-c851071a-287b-4cf7-b1a9-a4abad5b728f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1542a28e-87ed-4e2d-9254-3258dd7e69a7", "tag": "060d37d5-ce81-4b23-b6aa-21024529594d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:09.417004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:09.423125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3cf04d0e-6744-4436-8b54-b1747c33b381 req-c851071a-287b-4cf7-b1a9-a4abad5b728f service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:09.428485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3cf04d0e-6744-4436-8b54-b1747c33b381 req-c851071a-287b-4cf7-b1a9-a4abad5b728f service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:09.429340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3cf04d0e-6744-4436-8b54-b1747c33b381 req-c851071a-287b-4cf7-b1a9-a4abad5b728f service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:09.462933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-3cf04d0e-6744-4436-8b54-b1747c33b381 req-c851071a-287b-4cf7-b1a9-a4abad5b728f service nova] Creating event network-changed:060d37d5-ce81-4b23-b6aa-21024529594d for instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 on hv-cinder-85535 Aug 31 12:21:09.484429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-3cf04d0e-6744-4436-8b54-b1747c33b381 req-c851071a-287b-4cf7-b1a9-a4abad5b728f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091484 Aug 31 12:21:09.485520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 178/347] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:21:09.549994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:09.592001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a907c8c0-b8e2-4569-986e-fd775ee75c2b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.456462 Aug 31 12:21:09.592836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:09.595079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:09.608621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 170/348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:09 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:09.622636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:09.629525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:09.630258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:09.631150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:09.631795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:09.632366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:09.791243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d75233ca-5518-41db-a739-57c8966c6e2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: .version_select at 0x7fe855153dc0>, body: {"keypair": {"name": "tempest-keypair-1701752175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyYtWP2UDptzVkD+x7LVju5YjJbriZmhZqMtgfnsJt2ht6zj0+toxwZiMAsHE9coDgVNZu/zmirBpxbI0d6QsYqMqfK4Y67fOyR7bZHN/abvGFRBVmH41V47aBDKscevw=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:09.856592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-d75233ca-5518-41db-a739-57c8966c6e2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:21:09.876466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-d75233ca-5518-41db-a739-57c8966c6e2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:21:09.940916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d75233ca-5518-41db-a739-57c8966c6e2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158420 Aug 31 12:21:09.942254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 171/349] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:21:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:10.031391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:10.048155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-723bc351-851e-4b1e-be35-5726146586b9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.476726 Aug 31 12:21:10.060101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 179/350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:09 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:10.137020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:10.138058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:10.146004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:10.146962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:10.148014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:10.149622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:10.150268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:10.150821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:10.183538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:10.367335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:10.377514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:10.378951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:10.380152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-68ddafec-2ac3-4692-bdc5-56bae1ee8531 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1742 microversion: 2.20 time: 0.249081 Aug 31 12:21:10.380705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 172/351] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1742 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:10.624085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:10.624698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:10.631550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:10.632041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:10.632492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:10.633225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:10.633752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:10.634208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:10.774708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:10.783600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-058a1a5a-4df2-45fb-bcfd-088f8f2ac6b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.163694 Aug 31 12:21:10.784186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 180/352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:10 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:10.944461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57594da0-6624-4956-93e9-f2d11588db33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'create', calling method: .version_select at 0x7fe854ee0790>, body: {"keypair": {"name": "tempest-keypair-1419773043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOR+PP5NT4uwDEUZOn82RQ6vZIHug64+p9MY0qwg1z9f6MR1I73kXFJ1RUIlEgK+gRiKhghBfRvyAENqB6CLdhojDjgH4gd3WPUxw9x7l/gh4y+W9RSMcxzM0MPH3s+zA=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:10.962173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-57594da0-6624-4956-93e9-f2d11588db33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:21:10.966703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-57594da0-6624-4956-93e9-f2d11588db33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for user a8320be5e9644b6699ac526913e109eb and project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:21:10.998382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57594da0-6624-4956-93e9-f2d11588db33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058817 Aug 31 12:21:11.006140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 173/353] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:21:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:11.081783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:11.082873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:11.100561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.103609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.104723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.106481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.107210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.107920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.408456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:11.410604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:11.423935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.427101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.428107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.430267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.431471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.432978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.547899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:11.563770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04402680-3fbc-4403-aa01-2b13dfae9d9b tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.488545 Aug 31 12:21:11.575738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 181/354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:11 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:11.586540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-cecc0c23-a4c6-4144-ad98-8bd505e7df97 req-97c5cbab-68e8-436f-a206-4ab44dff7905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "name": "network-vif-plugged", "status": "completed", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:11.598691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-cecc0c23-a4c6-4144-ad98-8bd505e7df97 req-97c5cbab-68e8-436f-a206-4ab44dff7905 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.599226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-cecc0c23-a4c6-4144-ad98-8bd505e7df97 req-97c5cbab-68e8-436f-a206-4ab44dff7905 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.599776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-cecc0c23-a4c6-4144-ad98-8bd505e7df97 req-97c5cbab-68e8-436f-a206-4ab44dff7905 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.618486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-cecc0c23-a4c6-4144-ad98-8bd505e7df97 req-97c5cbab-68e8-436f-a206-4ab44dff7905 service nova] Creating event network-vif-plugged:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:21:11.628975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-cecc0c23-a4c6-4144-ad98-8bd505e7df97 req-97c5cbab-68e8-436f-a206-4ab44dff7905 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051524 Aug 31 12:21:11.631618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 182/355] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:11.811092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:11.812204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:11.813424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:11.821485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.822420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.823126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.824185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:11.825374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:11.826971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:11.837164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:11.838753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:11.843711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1a004bc1-2014-45e0-a043-0b6c6cec46fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1742 microversion: 2.20 time: 0.439083 Aug 31 12:21:11.851283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 174/356] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1742 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:11.892075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-259120365", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72511f19-18eb-4ec4-87f2-a581216ea81a"}], "security_groups": [{"name": "tempest-securitygroup--613808941"}], "key_name": "tempest-keypair-1701752175", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:12.065713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:12.066594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] validate_networks() for [('72511f19-18eb-4ec4-87f2-a581216ea81a', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:21:12.071062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:12.078441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-715cdda6-bd5b-49ba-acde-5d436606c72e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.273860 Aug 31 12:21:12.079922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 183/357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:11 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:12.560446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:21:12.561682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:21:12.562793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:21:12.563418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:21:12.565553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:21:12.579380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:12.580163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:12.581081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:12.581844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:12.582296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:12.582714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:12.591688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:12.592732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:12.601264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:12.602407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:12.603300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:12.604341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:12.605063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:12.605825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:12.608452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:21:12.613220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:21:12.616215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:12.633872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:21:12.636833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:21:12.728029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-23aa837b-0049-4d03-b934-859ddc78f674 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.836334 Aug 31 12:21:12.729153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 175/358] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:21:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:21:12.753930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-318acd90-4095-4e88-9762-c5921b466a52 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:12.754355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-318acd90-4095-4e88-9762-c5921b466a52 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:12.985845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-318acd90-4095-4e88-9762-c5921b466a52 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:13.003105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-318acd90-4095-4e88-9762-c5921b466a52 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1241 microversion: 2.1 time: 0.255520 Aug 31 12:21:13.006410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 176/359] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:12 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1241 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:13.020408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:13.021077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:13.051218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:13.051593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:13.054241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:13.055769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:13.056580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:13.056707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:13.139891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:13.177358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34502d9a-cea3-462b-9cd1-e76695d3e7d6 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.590651 Aug 31 12:21:13.201124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 184/360] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:12 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:13.227117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:13.229534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:13.290735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:13.296016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:13.297166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:13.301088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:13.305211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:13.310599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:13.755795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:13.771312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:13.775274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:13.780299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-562c6e1b-86f9-4437-b311-eb8131d7b61a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.770779 Aug 31 12:21:13.781523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 177/361] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:13.806307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1353911267", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "265e0c99-8589-4050-8cd1-2d515ee4b01d"}], "security_groups": [{"name": "tempest-securitygroup--2129114467"}], "key_name": "tempest-keypair-1419773043", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:13.892559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:13.921605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a4454675-3dad-4e07-9a84-b325cb624d04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.717083 Aug 31 12:21:13.943515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 185/362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:13 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:14.033871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:14.034495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:14.058513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:14.059126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:14.062059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:14.066667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:14.067463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:14.068110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:14.252576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] validate_networks() for [('265e0c99-8589-4050-8cd1-2d515ee4b01d', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:21:14.254844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:14.282586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3f6d389e-42e8-4f16-93ac-f665f1144cfc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1293 microversion: 2.1 time: 0.257438 Aug 31 12:21:14.289664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 186/363] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:14 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:14.295545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:14.296304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:14.303980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:14.304906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:14.305197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:14.307552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:14.308506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:14.309664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:14.796721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:14.813492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f04bdf68-f8e8-4c40-96c3-adf4dc79735c tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.522231 Aug 31 12:21:14.817436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 187/364] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:14 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:14.828988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:14.830109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:14.855709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:14.863374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:14.869520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:14.879180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:14.881934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:14.882845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.362438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:21:15.363253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:21:15.363743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:21:15.364223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:21:15.365066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:21:15.393211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:15.399486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:15.400787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.401862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:15.403271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:15.404285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.432531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:21:15.446359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Getting quotas for user a8320be5e9644b6699ac526913e109eb and project 8687bcf9d2a242b5af329bce4a8ad6d9. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:21:15.460873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:15.469069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:21:15.472181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:21:15.475607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:15.491780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:15.497300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae1c08ee-e562-4c3f-8c46-380072498410 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.676385 Aug 31 12:21:15.498055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 188/365] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:15.511195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:15.513285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:15.530207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:15.531414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:15.531860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.532596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:15.533709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:15.534128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.577064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-909a3578-8f9c-43be-99de-f1cebb66bf67 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.776353 Aug 31 12:21:15.583973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 178/366] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:21:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:21:15.583973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:15.584605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:15.593570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:15.594064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:15.594496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.595198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:15.595706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:15.596212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:15.807369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:15.825388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-805c87d5-e129-415f-9b6e-c908767aba47 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1299 microversion: 2.1 time: 0.246112 Aug 31 12:21:15.826758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 179/367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:15 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:15.834177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61b4d397-b23e-4d3f-8150-85df063016b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:15.839283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61b4d397-b23e-4d3f-8150-85df063016b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:16.020964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61b4d397-b23e-4d3f-8150-85df063016b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:16.036036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61b4d397-b23e-4d3f-8150-85df063016b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1246 microversion: 2.1 time: 0.207653 Aug 31 12:21:16.036633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 180/368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1246 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:16.051011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:16.064542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:16.065371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:16.068282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-011cc0e8-3d39-4ee2-9115-fcf75f949a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.568004 Aug 31 12:21:16.074325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 189/369] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:15 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:16.098917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:16.099538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:16.112155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:16.113072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:16.113571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:16.114017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:16.422904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:16.439300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c1fc907-4c57-4961-a20e-c117ef88da4f tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.401277 Aug 31 12:21:16.439993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 181/370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:16 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:16.526141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:16.527416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:16.537875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:16.538672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:16.539352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:16.542139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:16.542780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:16.543788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:16.860914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:16.863974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:16.902482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:16.906453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:16.907989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:16.911941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:16.916821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:16.919158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:17.103373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:17.177912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:17.204221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:17.209028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e3530e6-fcdf-473d-9601-f9b72d77373c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.684391 Aug 31 12:21:17.231268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 190/371] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:17.231887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:17.233077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:17.253546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:17.253822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:17.254589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:17.255843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:17.256851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:17.258730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:17.890095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:17.901588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-10b57827-f739-4ac6-874e-33c4e705e11e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1298 microversion: 2.1 time: 0.682958 Aug 31 12:21:17.908110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 191/372] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1298 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:17.913609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:17.915742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:17.938974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:17.939521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:17.939998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:17.941020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:17.941530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:17.942038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.144397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:18.155272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a86d832c-3944-424f-a2eb-f19f60ae1646 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 1.304468 Aug 31 12:21:18.157611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 182/373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:16 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:18.164186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:18.165803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:18.174948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.176518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.178895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.180558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.181255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.181942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.559897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:18.590687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee95c880-b426-4285-9ca9-310b09ae14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.680589 Aug 31 12:21:18.598332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 192/374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:17 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:18.642286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d73645ec-cf57-415e-b21f-af25493f4d68 req-da4f4206-bf1e-44a5-b955-643e0a591d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1542a28e-87ed-4e2d-9254-3258dd7e69a7", "name": "network-vif-plugged", "status": "completed", "tag": "060d37d5-ce81-4b23-b6aa-21024529594d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:18.672540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d73645ec-cf57-415e-b21f-af25493f4d68 req-da4f4206-bf1e-44a5-b955-643e0a591d87 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.673650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d73645ec-cf57-415e-b21f-af25493f4d68 req-da4f4206-bf1e-44a5-b955-643e0a591d87 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.674583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d73645ec-cf57-415e-b21f-af25493f4d68 req-da4f4206-bf1e-44a5-b955-643e0a591d87 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.719006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d73645ec-cf57-415e-b21f-af25493f4d68 req-da4f4206-bf1e-44a5-b955-643e0a591d87 service nova] Creating event network-vif-plugged:060d37d5-ce81-4b23-b6aa-21024529594d for instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 on hv-cinder-85535 Aug 31 12:21:18.731018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d73645ec-cf57-415e-b21f-af25493f4d68 req-da4f4206-bf1e-44a5-b955-643e0a591d87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097459 Aug 31 12:21:18.749125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 193/375] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:18.773337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:18.777744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:18.780352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:18.795403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84436c3b-4d01-4677-ba89-847ba138b063 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.635894 Aug 31 12:21:18.796370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 183/376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:18 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:18.830176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.831034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.833420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.834650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.837216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.838077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.933674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:18.934474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:18.949003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.949675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.950236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:18.952104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:18.953294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:18.956177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:19.134462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:19.156144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad99b533-6b2c-4e5b-bd4c-5a248e6d5827 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1304 microversion: 2.1 time: 0.226419 Aug 31 12:21:19.158815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 184/377] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:19.186688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:19.187465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:19.198505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:19.201820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:19.204750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:19.205877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:19.207879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:19.209896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:19.475339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:19.488412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:19.498285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:19.499568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f5c54287-7834-4d99-96b7-62748e009c89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.748822 Aug 31 12:21:19.500448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 194/378] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:19.646054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:19.646804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:19.672325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:19.673208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:19.673927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:19.675089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:19.676617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:19.677504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:19.825836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:19.836812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a02f8e2-8343-43ad-9aa2-7a160307445b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.653685 Aug 31 12:21:19.840337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 185/379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:19 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:19.846368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:19.847969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:19.870302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:19.877060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:19.877060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:19.877310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:19.877608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:19.878038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:20.517428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:20.528744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6eff473b-7dc8-4255-bca5-14b35a4e63bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.887789 Aug 31 12:21:20.535729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 195/380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:19 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:20.551939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:20.556557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:20.572593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:20.573720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:20.576711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:20.577558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:20.580815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:20.581603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:20.582217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:20.595362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1275bc67-ce80-417b-a386-2784355bb797 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1314 microversion: 2.1 time: 0.750435 Aug 31 12:21:20.597508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 186/381] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:19 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:20.609829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:20.611035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:20.618947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:20.620708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:20.621613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:20.623550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:20.624629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:20.625657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.011318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:21.022212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:21.024334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:21.027625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73226b15-84ef-4ab8-b4c7-c598b8dfb234 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.428184 Aug 31 12:21:21.028635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 187/382] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:21.040523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-dc1f392b-ea7b-4edc-bfae-af3bd8cd810d req-bcb1a612-98a2-4ca2-a1ae-7dd71dc332c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa04fef6-94a1-4065-a428-01e95e76cdf4", "tag": "5c79a0d4-e20a-4833-b8e1-9ea66396c0a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:21.057174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:21.058922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dc1f392b-ea7b-4edc-bfae-af3bd8cd810d req-bcb1a612-98a2-4ca2-a1ae-7dd71dc332c9 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.059659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dc1f392b-ea7b-4edc-bfae-af3bd8cd810d req-bcb1a612-98a2-4ca2-a1ae-7dd71dc332c9 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.060598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dc1f392b-ea7b-4edc-bfae-af3bd8cd810d req-bcb1a612-98a2-4ca2-a1ae-7dd71dc332c9 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.066785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d2fa72be-145f-4bc0-acb2-946665118b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.528533 Aug 31 12:21:21.082626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 196/383] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:21.084652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-dc1f392b-ea7b-4edc-bfae-af3bd8cd810d req-bcb1a612-98a2-4ca2-a1ae-7dd71dc332c9 service nova] Creating event network-changed:5c79a0d4-e20a-4833-b8e1-9ea66396c0a2 for instance fa04fef6-94a1-4065-a428-01e95e76cdf4 on hv-cinder-85535 Aug 31 12:21:21.087780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-9b3f2ae5-67d9-4491-acbf-e333779d9774 req-766e760f-8d0a-4ad0-9251-628002f73b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cc2e2-509e-4bf7-a56f-28002021cda8", "name": "network-vif-plugged", "status": "completed", "tag": "f298c8bf-7f0e-415b-9af7-b4dc0033bf36"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:21.093960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-dc1f392b-ea7b-4edc-bfae-af3bd8cd810d req-bcb1a612-98a2-4ca2-a1ae-7dd71dc332c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060407 Aug 31 12:21:21.101175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-9b3f2ae5-67d9-4491-acbf-e333779d9774 req-766e760f-8d0a-4ad0-9251-628002f73b06 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.101486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-9b3f2ae5-67d9-4491-acbf-e333779d9774 req-766e760f-8d0a-4ad0-9251-628002f73b06 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.102681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-9b3f2ae5-67d9-4491-acbf-e333779d9774 req-766e760f-8d0a-4ad0-9251-628002f73b06 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.103686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 188/384] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:21.112617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:21.114013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:21.120815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-9b3f2ae5-67d9-4491-acbf-e333779d9774 req-766e760f-8d0a-4ad0-9251-628002f73b06 service nova] Creating event network-vif-plugged:f298c8bf-7f0e-415b-9af7-b4dc0033bf36 for instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 on hv-cinder-85535 Aug 31 12:21:21.126788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.127785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-9b3f2ae5-67d9-4491-acbf-e333779d9774 req-766e760f-8d0a-4ad0-9251-628002f73b06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043356 Aug 31 12:21:21.128796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.129440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 197/385] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:21.129728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.130810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.132442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.132970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.136563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-96089dab-c1f3-4cd5-adbb-d9fbff95beda req-d745c578-7299-4549-be39-b6ee9c9f05f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:21.148850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-96089dab-c1f3-4cd5-adbb-d9fbff95beda req-d745c578-7299-4549-be39-b6ee9c9f05f9 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.150085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-96089dab-c1f3-4cd5-adbb-d9fbff95beda req-d745c578-7299-4549-be39-b6ee9c9f05f9 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.150714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-96089dab-c1f3-4cd5-adbb-d9fbff95beda req-d745c578-7299-4549-be39-b6ee9c9f05f9 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.165394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-96089dab-c1f3-4cd5-adbb-d9fbff95beda req-d745c578-7299-4549-be39-b6ee9c9f05f9 service nova] Creating event network-changed:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:21:21.174010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-96089dab-c1f3-4cd5-adbb-d9fbff95beda req-d745c578-7299-4549-be39-b6ee9c9f05f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042789 Aug 31 12:21:21.175186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 198/386] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:21.371745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:21.405899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80da8b31-39c6-4bbd-9029-a687d992c224 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.297335 Aug 31 12:21:21.409037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 189/387] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:21 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:21.559341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:21.560180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:21.572352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.572866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.573364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.574498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.582629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.583219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.623058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:21.624101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:21.636229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.636932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.637657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:21.638900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:21.639799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:21.640476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.067747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.078350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9789d1f1-f52d-4796-9a72-e466e9706d47 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1463 microversion: 2.1 time: 0.459287 Aug 31 12:21:22.087889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 190/388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:21 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1463 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:22.096149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:22.101136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:22.114580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.153502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1ad0405f-2534-4cee-813e-c1f86d8120c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.586843 Aug 31 12:21:22.162552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 199/389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:21 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:22.165959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.166459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.166898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.177226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.182780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.183355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.185331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:22.185953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:22.212514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.222550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.223060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.228394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.228876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.229308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.521605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.544502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8406bfbc-8e20-4f6b-8e85-491f8ec9ba0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.380237 Aug 31 12:21:22.545386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 200/390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:22.564179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.566715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:22.568428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:22.577620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.578665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.579079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.579784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.580888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.582515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.583182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.583954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.586218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2a04e66-0233-4317-8fa9-fba761b639ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.496095 Aug 31 12:21:22.587282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 191/391] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:22.595191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:22.596801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:22.612156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.612858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.613454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.614283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.614865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.615422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.622039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:21:22.663677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:22.766624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-45d5dc3e-d2f6-4c8c-acae-b00bc38b8a85 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 204 len: 0 microversion: 2.1 time: 0.203704 Aug 31 12:21:22.767645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 201/392] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:21:22 2022] DELETE /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:21:22.779024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:22.779771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:22.794707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.795878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.796706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.797887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:22.798592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:22.799329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:22.827080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.836158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca9f82f6-a460-472b-af63-71a91aeece28 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.246878 Aug 31 12:21:22.839038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 192/393] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:22 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:22.987434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:22.998859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-50fca032-16e9-490d-928e-a7e0f91a1562 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1469 microversion: 2.1 time: 0.225863 Aug 31 12:21:23.015872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 202/394] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:22 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:23.184306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:23.184926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:23.192218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.193101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.193962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.195884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.196918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.197669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.386850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:23.394081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:23.396990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dca43863-f632-4e7f-b4e1-9052016f2fcf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.217733 Aug 31 12:21:23.398074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 193/395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:23 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:23.568278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:23.568902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:23.576694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.577183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.577620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.578318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.578766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.579395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.618185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:23.619095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:23.654469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.659891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.661139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.662669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.663781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.664528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.931115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:23.941685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad743b51-85d2-455d-8da5-6277935538a4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.377194 Aug 31 12:21:23.943294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 203/396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:23.950896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:23.952296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:23.961820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.962897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.963604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.964568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:23.965219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:23.965827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:23.994280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:24.008856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:24.011597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:24.013474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-892c21f0-57d1-48e1-b6f3-9b545ba5565e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.400786 Aug 31 12:21:24.015008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 194/397] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:24.026661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:24.027893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:24.036108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:24.037408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:24.041237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:24.042909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:24.043669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:24.044840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:24.227636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:24.240281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18f39164-70b4-4c86-8c78-0b5a9664c44c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.294929 Aug 31 12:21:24.241993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 204/398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:23 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:24.306739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:24.318425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c1a64f3-32fd-4dc0-8fc4-46ebf1224440 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1469 microversion: 2.1 time: 0.297581 Aug 31 12:21:24.319087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 195/399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:24 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:24.428308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:24.430026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:24.438582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:24.439222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:24.439794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:24.440648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:24.441175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:24.441671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:24.651351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:24.665040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d409373-e595-4ee6-8216-541dcefee7c5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1318 microversion: 2.1 time: 0.242886 Aug 31 12:21:24.666200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 205/400] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:24 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:24.962783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:24.964101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:24.973645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:24.974253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:24.974507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:24.975359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:24.975677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:24.976144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.047900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:25.047900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:25.087706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.088744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.089451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.094471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.099168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.100362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.336507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:25.347378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:25.354793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:25.354793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:25.355257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b41fc5ab-7387-40a9-9664-bc81b1c200e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.313984 Aug 31 12:21:25.356380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 206/401] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:25.361378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:25.362283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:25.364235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-994c63e9-2ef0-4cd4-93df-bf0e31bc7cd4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.405821 Aug 31 12:21:25.367477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 196/402] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:25.382997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.383400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:25.383681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.384177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.384630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:25.385092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.385622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.386229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.400423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.401658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.402396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.403507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.404345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.405143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.440362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:25.771046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:25.821053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8febeb2a-f28e-4445-892d-2ef785dab0d9 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1469 microversion: 2.1 time: 0.446554 Aug 31 12:21:25.823521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 197/403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:25 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:25.833421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:25.834901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:25.845605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.846572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.846875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:25.847451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.849026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:25.850280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:25.851034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:25.885176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25f6a50c-6198-4f15-8d8d-759bf4cd96c3 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.527349 Aug 31 12:21:25.886443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 207/404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:25 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:26.028169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=24 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:26.081962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:26.092897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-501eec75-975f-450e-bb62-4c13d29a807e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1507 microversion: 2.1 time: 0.266470 Aug 31 12:21:26.100943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 198/405] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:25 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:26.387415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:26.388648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:26.396560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:26.402460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.402948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.403481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.404251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.404699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.404950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:26.405109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.424577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.425445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.426572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.431598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.432303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.432946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.686376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:26.703551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:26.703950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:26.706005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:26.710417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c38b636-fd6c-4382-8842-4f5c42571d93 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.326948 Aug 31 12:21:26.711674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 208/406] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:26.713411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4d5cff16-1aa3-4ffb-88ed-9e0b89b06d80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.323283 Aug 31 12:21:26.715640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 199/407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:26.864042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:26.864715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:26.878193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.879217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.880064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.881124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.881816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.882333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.917499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:26.918153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:26.926067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.926630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.927082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:26.927817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:26.928267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:26.928740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:27.132328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:27.163460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e12e6a4d-0405-40da-a4df-0adbd5299ec1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1469 microversion: 2.1 time: 0.304032 Aug 31 12:21:27.175623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 209/408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:26 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:27.236610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:27.246337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48dfed14-1daa-4d3a-93de-90c90eb8fc0b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.341683 Aug 31 12:21:27.246930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 200/409] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:26 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:27.734632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:27.735217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:27.741092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:27.742014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:27.759779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:27.764632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:27.765903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:27.765903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:27.766550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:27.766550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:27.767143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:27.786743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:27.786743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:27.787100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:27.788026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:27.788026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:28.289388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:28.303442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:28.309711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:28.311457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:28.313232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4a0bada-9c22-4197-964a-689b44d2ef03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.576741 Aug 31 12:21:28.313987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 201/410] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:28.319040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-134235e1-da60-45af-97fb-6a330e647aa3 req-fef5d6a6-3217-420c-8455-434d92f518dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa04fef6-94a1-4065-a428-01e95e76cdf4", "name": "network-vif-plugged", "status": "completed", "tag": "5c79a0d4-e20a-4833-b8e1-9ea66396c0a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:28.337167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3db05297-b88d-4b33-a3bf-ec9d4825fa50 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.600593 Aug 31 12:21:28.341950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 210/411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:28.348157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:28.349172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:28.355073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-134235e1-da60-45af-97fb-6a330e647aa3 req-fef5d6a6-3217-420c-8455-434d92f518dd service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:28.355840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-134235e1-da60-45af-97fb-6a330e647aa3 req-fef5d6a6-3217-420c-8455-434d92f518dd service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:28.356439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-134235e1-da60-45af-97fb-6a330e647aa3 req-fef5d6a6-3217-420c-8455-434d92f518dd service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:28.375762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:28.376778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-134235e1-da60-45af-97fb-6a330e647aa3 req-fef5d6a6-3217-420c-8455-434d92f518dd service nova] Creating event network-vif-plugged:5c79a0d4-e20a-4833-b8e1-9ea66396c0a2 for instance fa04fef6-94a1-4065-a428-01e95e76cdf4 on hv-cinder-85535 Aug 31 12:21:28.379580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:28.380033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:28.380799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:28.381230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:28.383096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-134235e1-da60-45af-97fb-6a330e647aa3 req-fef5d6a6-3217-420c-8455-434d92f518dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067776 Aug 31 12:21:28.384394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 202/412] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:28.388495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:28.390216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:28.391059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:28.399102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:28.399904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:28.400609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:28.401566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:28.402286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:28.403091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:28.905938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:28.912298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:28.919729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d136d052-4a15-4ac5-804a-c8df2e6ff1e1 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1469 microversion: 2.1 time: 0.575948 Aug 31 12:21:28.920364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 211/413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:28 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1469 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:28.924207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b20d1bd-14a5-46b8-bb4f-9e8449610942 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.538150 Aug 31 12:21:28.925011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 203/414] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:28 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:29.068671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d12df43d-21d3-41bb-ae82-aa7e55d09a77 req-3fbf184b-ef06-4348-9b69-9b841d626782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1542a28e-87ed-4e2d-9254-3258dd7e69a7", "name": "network-vif-deleted", "tag": "060d37d5-ce81-4b23-b6aa-21024529594d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:29.087811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d12df43d-21d3-41bb-ae82-aa7e55d09a77 req-3fbf184b-ef06-4348-9b69-9b841d626782 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.088345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d12df43d-21d3-41bb-ae82-aa7e55d09a77 req-3fbf184b-ef06-4348-9b69-9b841d626782 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.088976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d12df43d-21d3-41bb-ae82-aa7e55d09a77 req-3fbf184b-ef06-4348-9b69-9b841d626782 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.108090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d12df43d-21d3-41bb-ae82-aa7e55d09a77 req-3fbf184b-ef06-4348-9b69-9b841d626782 service nova] Creating event network-vif-deleted:060d37d5-ce81-4b23-b6aa-21024529594d for instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 on hv-cinder-85535 Aug 31 12:21:29.113416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d12df43d-21d3-41bb-ae82-aa7e55d09a77 req-3fbf184b-ef06-4348-9b69-9b841d626782 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051655 Aug 31 12:21:29.114036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 212/415] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:29.347104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:29.347924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:29.355547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.356075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.356514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.357233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.357684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.358105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.362476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:29.363561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:29.373512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.374000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.374434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.375265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.375650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.376324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.845555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:29.857634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:29.863020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:29.866493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:29.867848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d67f60f7-9019-45f8-b335-983d7caf92b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1737 microversion: 2.20 time: 0.526363 Aug 31 12:21:29.887114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 204/416] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1737 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:29.887419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9532cb76-66db-4d66-ace4-8c66acade8bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.513481 Aug 31 12:21:29.887419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 213/417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:29.942527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:29.943194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:29.950797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.951359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.951820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.952612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.953073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.953655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.959099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:29.960854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:29.968766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.969380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.969919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:29.970886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:29.971605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:29.972122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:30.029486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:30.042454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4af65ef0-1e1e-464b-bdfa-066040fd1c54 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1299 microversion: 2.1 time: 0.103639 Aug 31 12:21:30.043158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 205/418] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:29 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:30.158340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:30.171140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e08599c-6119-4614-ad97-1e4eb3428080 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1366 microversion: 2.1 time: 0.216655 Aug 31 12:21:30.171926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 214/419] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:29 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:30.501152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ba7b3446-61fe-4986-95a1-fef6db8d1148 req-bad48b05-fb44-4611-886c-4063ff23d632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "name": "network-vif-plugged", "status": "completed", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:30.510957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ba7b3446-61fe-4986-95a1-fef6db8d1148 req-bad48b05-fb44-4611-886c-4063ff23d632 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:30.511456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ba7b3446-61fe-4986-95a1-fef6db8d1148 req-bad48b05-fb44-4611-886c-4063ff23d632 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:30.511902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ba7b3446-61fe-4986-95a1-fef6db8d1148 req-bad48b05-fb44-4611-886c-4063ff23d632 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:30.524506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ba7b3446-61fe-4986-95a1-fef6db8d1148 req-bad48b05-fb44-4611-886c-4063ff23d632 service nova] Creating event network-vif-plugged:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:21:30.529635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ba7b3446-61fe-4986-95a1-fef6db8d1148 req-bad48b05-fb44-4611-886c-4063ff23d632 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 Aug 31 12:21:30.530268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 206/420] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:30.895844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:30.896580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:30.897835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:30.898378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:30.904620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:30.905120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:30.905355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:30.905607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:30.905846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:30.906343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:30.906580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:30.907033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:30.907133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:30.907471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:30.907587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:30.908001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.209208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:31.215879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:31.219880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d8a7fe36-c729-4683-a34c-24e13a4405f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.329178 Aug 31 12:21:31.220970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 215/421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:31.230530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:31.231138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:31.232020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:31.237664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:31.240049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d4dff26-04eb-47e4-9edc-dbfeb5767dc3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1719 microversion: 2.20 time: 0.346477 Aug 31 12:21:31.240656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 207/422] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1719 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:31.253060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:31.254317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:31.270863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.271594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.272325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.273307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.273756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.274174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.278109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.281630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.281630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.282087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.282536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.283125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.347956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.348756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.349193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.349719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lazy-loading 'fault' on Instance uuid 1542a28e-87ed-4e2d-9254-3258dd7e69a7 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:21:31.449488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d60bea32ca4476d84d00d9ff95f3516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90897266779e40028dc2be9301efff53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:31.463747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5c56f28d-0eef-4239-a3f5-7dcba784fe22 tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 200 len: 1304 microversion: 2.1 time: 0.241915 Aug 31 12:21:31.464922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 216/423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:31 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 1304 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:31.526994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:31.536159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d5d6fca2-edad-42e9-afe5-1d8324c81ab5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1557 microversion: 2.1 time: 0.292429 Aug 31 12:21:31.536719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 208/424] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:31 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1557 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:31.559771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:31.560280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:31.566805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.567305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.567732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.568429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:31.568867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:31.569302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:31.656576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-50820ab0-8328-4ae3-bca2-08dd603ef519 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100587 Aug 31 12:21:31.657162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 217/425] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:21:31 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:32.243307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:32.244305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:32.252418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.253391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.253784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.254407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.254874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.255311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.273425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:32.274670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:32.281451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.281990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.282585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.283491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.284012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.284507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.289708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:32.524860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:32.536437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:32.545803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-72b04502-81e0-454e-afc1-0db5cb3318ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.307191 Aug 31 12:21:32.546392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 209/426] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:32.549553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:32.551468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:32.551654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:32.552222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] [instance: 1542a28e-87ed-4e2d-9254-3258dd7e69a7] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:32.553561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49d0b18b-3e89-493d-b8fc-bf768b115707 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1719 microversion: 2.20 time: 0.284488 Aug 31 12:21:32.554335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 218/427] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1719 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:32.558882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.559705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.560314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.561173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.561774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.562339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.579166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] HTTP exception thrown: Instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 could not be found. Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Request method failure captured: Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 HTTP/1.1 Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1IfYBUR89Tmk06fdmXH_rVUUPwqnb1x5QNgHYBZ5PhfCzWhhTRM19nO1ApgfY0WQo9pRQTOXBJI6UkQjerhwbYtrGZ3j1g-56OXisVv4L1aQ1ZTEgPoE7pLWJh4Bmbt4WGlPe3jKX_SdwImI4bKffYZu4yTrX2JRLlEEkTs2nRCt7U Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 90897266779e40028dc2be9301efff53 Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-132861112 Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:21:32.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90897266779e40028dc2be9301efff53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/90897266779e40028dc2be9301efff53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/90897266779e40028dc2be9301efff53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_90897266779e40028dc2be9301efff53", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-132861112 Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 90897266779e40028dc2be9301efff53 Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-132861112 Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-132861112-project Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 7d60bea32ca4476d84d00d9ff95f3516 Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-132861112-project Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 could not be found. Aug 31 12:21:32.583217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '1542a28e-87ed-4e2d-9254-3258dd7e69a7'} Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 could not be found. Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:21:32.584538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 could not be found. Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 could not be found. Aug 31 12:21:32.587117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:21:32.588751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] Returning 404 to user: Instance 1542a28e-87ed-4e2d-9254-3258dd7e69a7 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:21:32.588751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5e006175-1cbe-4d0d-999b-26b2334694af tempest-VolumesNegativeTest-132861112 tempest-VolumesNegativeTest-132861112-project] 10.222.0.27 "GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7" status: 404 len: 111 microversion: 2.1 time: 0.035308 Aug 31 12:21:32.588751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 210/428] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:32 2022] GET /compute/v2.1/servers/1542a28e-87ed-4e2d-9254-3258dd7e69a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:21:32.895604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-ff3719d6-a250-452a-8db0-2bcb2a7ccd46 req-12f3b190-0aee-4b2f-b734-548aed94e4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa04fef6-94a1-4065-a428-01e95e76cdf4", "tag": "5c79a0d4-e20a-4833-b8e1-9ea66396c0a2"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:32.905046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-ff3719d6-a250-452a-8db0-2bcb2a7ccd46 req-12f3b190-0aee-4b2f-b734-548aed94e4ab service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:32.905529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-ff3719d6-a250-452a-8db0-2bcb2a7ccd46 req-12f3b190-0aee-4b2f-b734-548aed94e4ab service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:32.905990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-ff3719d6-a250-452a-8db0-2bcb2a7ccd46 req-12f3b190-0aee-4b2f-b734-548aed94e4ab service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:32.921118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-ff3719d6-a250-452a-8db0-2bcb2a7ccd46 req-12f3b190-0aee-4b2f-b734-548aed94e4ab service nova] Creating event network-changed:5c79a0d4-e20a-4833-b8e1-9ea66396c0a2 for instance fa04fef6-94a1-4065-a428-01e95e76cdf4 on hv-cinder-85535 Aug 31 12:21:32.926992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-ff3719d6-a250-452a-8db0-2bcb2a7ccd46 req-12f3b190-0aee-4b2f-b734-548aed94e4ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039546 Aug 31 12:21:32.927654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 219/429] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:33.057085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:33.060166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:33.066803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.067325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.067756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.068518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.068970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.069547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.150090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:33.179994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3d369bd7-6e8e-4c65-a408-c265f5282739 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action" status: 202 len: 0 microversion: 2.1 time: 0.126357 Aug 31 12:21:33.189082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 211/430] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:21:33 2022] POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:21:33.206464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:33.207589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:33.215586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.216546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.217067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.217859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.218510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.219074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.416863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:33.427606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c6f4899-1129-447a-89de-0bba7b4ec8b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1753 microversion: 2.1 time: 0.230719 Aug 31 12:21:33.428716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 220/431] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:33.575298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:33.576667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:33.582722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:33.585336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.585841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.586267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.586969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.587444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.587862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.603647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:33.605005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:33.615553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.616466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.617064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.618079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.619187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.619900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.826917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:33.841290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e48ba9bb-8fff-4db2-a5ee-0e96987d3c3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1372 microversion: 2.1 time: 0.271577 Aug 31 12:21:33.842732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 212/432] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:33.867051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:33.885853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:33.889230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:33.891850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c3c3feb-9a28-4559-99cb-3e5d819980d9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1719 microversion: 2.20 time: 0.293074 Aug 31 12:21:33.915751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 221/433] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1719 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:33.961958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-679c3efc-ff15-4eba-b2a3-843780452000 req-1f4dc03b-c69f-4b40-a56e-881920f01f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "name": "network-vif-unplugged", "status": "completed", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:33.975549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-679c3efc-ff15-4eba-b2a3-843780452000 req-1f4dc03b-c69f-4b40-a56e-881920f01f92 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:33.976798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-679c3efc-ff15-4eba-b2a3-843780452000 req-1f4dc03b-c69f-4b40-a56e-881920f01f92 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:33.977544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-679c3efc-ff15-4eba-b2a3-843780452000 req-1f4dc03b-c69f-4b40-a56e-881920f01f92 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:33.996765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-679c3efc-ff15-4eba-b2a3-843780452000 req-1f4dc03b-c69f-4b40-a56e-881920f01f92 service nova] Creating event network-vif-unplugged:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:21:34.004200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-679c3efc-ff15-4eba-b2a3-843780452000 req-1f4dc03b-c69f-4b40-a56e-881920f01f92 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046683 Aug 31 12:21:34.004931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 213/434] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:34.452604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:34.453376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:34.467633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:34.468169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:34.468608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:34.469546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:34.469885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:34.470217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:34.870250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:34.873676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:34.885543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:34.886435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:34.887167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:34.888511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:34.889299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:34.890155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:34.908934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:34.931038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0e260e13-fbc0-4cc3-915e-d1b59186ef7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1753 microversion: 2.1 time: 0.483372 Aug 31 12:21:34.933193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 222/435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1753 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:34.955685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:34.956390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:34.966211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:34.966977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:34.967764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:34.968809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:34.969461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:34.969958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:35.179383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:35.190965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e638c2c0-d6de-4d5a-913a-dc25eb11c0ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1565 microversion: 2.1 time: 0.327937 Aug 31 12:21:35.192007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 214/436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1565 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:35.200131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:35.210545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:35.212873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:35.214345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4d7e602-388b-4099-bfc2-10430de68638 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1722 microversion: 2.20 time: 0.279499 Aug 31 12:21:35.214908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 223/437] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:35.215883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:35.216376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:35.223205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:35.224033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:35.225375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:35.227363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:35.227915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:35.228445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:35.256285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeaba963-7614-4090-8e58-3a50538fbaa8"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:35.260014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:35.262101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:35.267710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:35.268438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:35.269082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:35.269998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:35.270724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:35.271337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:35.359482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-18fe9a75-d686-4275-8e5e-8bd32a9ed99f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147372 Aug 31 12:21:35.360151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 215/438] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:21:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:35.931290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ddb980de-a49a-479e-b60e-7c321678e11c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.682751 Aug 31 12:21:35.932765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 224/439] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Aug 31 12:21:35 2022] POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 188 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:21:35.968519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:35.970673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:35.985979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:35.986989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:35.987695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:35.988903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:35.990487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:35.991295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:36.185285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:36.186300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:36.203526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:36.204401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:36.204991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:36.205982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:36.206682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:36.207354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:36.319882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120573) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 12:21:36.477836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e278150c-729a-4cee-b759-8d1af180161d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/action" status: 202 len: 0 microversion: 2.20 time: 0.296788 Aug 31 12:21:36.478605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 225/440] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 31 12:21:36 2022] POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:21:36.490073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:36.490759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:36.508669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:36.509232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:36.509801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:36.510749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:36.511433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:36.512150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:36.618544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:36.627891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-083b2ccd-6e63-4f3c-8105-8d7284b32317 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1753 microversion: 2.1 time: 0.675764 Aug 31 12:21:36.633288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 216/441] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1753 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:36.916589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:36.949995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:36.952361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:36.954211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-86c65bd2-9ad8-4529-807f-2f4bba800e62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1748 microversion: 2.20 time: 0.470052 Aug 31 12:21:36.968098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 226/442] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1748 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:37.615637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e0b70bbc-b48d-4a25-9595-4cc1a1a4c8bf req-f3b5c61f-d1fe-46f1-94cb-71a588e672fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:37.627195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e0b70bbc-b48d-4a25-9595-4cc1a1a4c8bf req-f3b5c61f-d1fe-46f1-94cb-71a588e672fb service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:37.628289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e0b70bbc-b48d-4a25-9595-4cc1a1a4c8bf req-f3b5c61f-d1fe-46f1-94cb-71a588e672fb service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:37.629110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e0b70bbc-b48d-4a25-9595-4cc1a1a4c8bf req-f3b5c61f-d1fe-46f1-94cb-71a588e672fb service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:37.655131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:37.655963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:37.657521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e0b70bbc-b48d-4a25-9595-4cc1a1a4c8bf req-f3b5c61f-d1fe-46f1-94cb-71a588e672fb service nova] Creating event network-changed:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:21:37.666574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e0b70bbc-b48d-4a25-9595-4cc1a1a4c8bf req-f3b5c61f-d1fe-46f1-94cb-71a588e672fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054268 Aug 31 12:21:37.667837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 217/443] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:37.674098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:37.674602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:37.677657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:37.678974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:37.681353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:37.682080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:37.982641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:37.992638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:38.009199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:38.010088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:38.010845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:38.012136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:38.013011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:38.013649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:38.112358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:38.138412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d16a52cb-7c0b-478e-bb59-a9324e766147 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.486381 Aug 31 12:21:38.142084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 227/444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:38.394036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:38.408645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:38.412972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:38.414558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-877dbf77-9fd4-4fae-ad99-ea012b2487e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1748 microversion: 2.20 time: 0.437359 Aug 31 12:21:38.433750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 218/445] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1748 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:39.165265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:39.165768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:39.174921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:39.175725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:39.176126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:39.176987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:39.177656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:39.178145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:39.422943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:39.433840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-736baa0c-0894-48ab-a1e8-027ed7d095d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.273889 Aug 31 12:21:39.436142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 228/446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:39.443082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:39.443993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:39.457486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:39.458034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:39.458607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:39.459632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:39.460266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:39.460772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:39.633597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:39.643032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:39.644610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:39.645969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3170368a-7499-411e-b874-ce1bf56fa065 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1750 microversion: 2.20 time: 0.208077 Aug 31 12:21:39.647598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 219/447] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1750 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:40.457243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:40.457950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:40.465145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:40.465637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:40.466068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:40.466772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:40.467219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:40.467667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:40.670316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:40.670945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:40.679711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:40.680390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:40.680920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:40.681779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:40.682432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:40.682943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:40.699827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:40.711175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2aea89b0-558e-4871-a697-f2549fc19816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.257496 Aug 31 12:21:40.712255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 229/448] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:40.924395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:40.935538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:40.937105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:40.938312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1684bba4-e33d-4b1c-90f8-8ba38e06b351 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.272316 Aug 31 12:21:40.938875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 220/449] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:41.735869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:41.736489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:41.745522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:41.746007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:41.746467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:41.747184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:41.747652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:41.748072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:41.924174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:41.934691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b41dcac5-d7b3-48ef-a440-bfcd40ef05f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.202560 Aug 31 12:21:41.935684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 230/450] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:41.971508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:41.974357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:41.990701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:41.994849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:41.995785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:41.997342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:41.999214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:42.000238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:42.187777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:42.198436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:42.200365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:42.201769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1fa242f8-d27d-49d0-ab8c-2bc88b3addc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.240316 Aug 31 12:21:42.203137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 221/451] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:42.963862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:42.965280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:42.972011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:42.972497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:42.972922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:42.973855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:42.974298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:42.974699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:43.134253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:43.137735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:43.143826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa4e5f01-2c84-40ab-9523-876d84246ffc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.184449 Aug 31 12:21:43.144404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 231/452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:43.226976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:43.227678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:43.237803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:43.238298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:43.238733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:43.239517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:43.239996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:43.240505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:43.474187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:43.488008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:43.490017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:43.491402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-871ee5f9-fef7-474c-8afb-d6e9889fe862 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.268997 Aug 31 12:21:43.492092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 222/453] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:44.169551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:44.170160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:44.179037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:44.179645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:44.180167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:44.180930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:44.181586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:44.182210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:44.361142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:44.370146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e47369f6-ce2f-479c-9b18-f4b06d40067e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.206237 Aug 31 12:21:44.370641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 232/454] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:44.415219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5313ff0-9c21-4ddb-85b0-57f3cf913855", "device": "/dev/sdb"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:21:44.419389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:44.429535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:44.430058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:44.430483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:44.431209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:44.431687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:44.432098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:44.515855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:44.516467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:44.522833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:44.523361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:44.523801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:44.524510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:44.524958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:44.525380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:44.667389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:44.678847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:44.680745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:44.682383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0acdb1db-4724-44d8-b176-6d76d9f028ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.170126 Aug 31 12:21:44.683627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 233/455] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:45.392135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:45.393091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:45.401828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:45.402319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:45.402747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:45.405438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:45.405438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:45.405438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:45.580849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:45.589963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-24e4f8e0-9a7c-464a-a23f-092412c7c794 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.201947 Aug 31 12:21:45.590547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 234/456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:45.707325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:45.708143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:45.715176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:45.715708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:45.716149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:45.716847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:45.717464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:45.718052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:45.866628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:45.876870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:45.878400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:45.879836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8ac17182-23c3-43ee-b832-b2af0c1ef663 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.177338 Aug 31 12:21:45.880565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 235/457] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:46.611656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:46.612737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:46.620802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:46.621287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:46.622207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:46.623977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:46.624527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:46.624945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:46.801000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:46.809956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-129ffb52-91b5-41c8-9dd9-337726c95eaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.202291 Aug 31 12:21:46.810535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 236/458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:46.904680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:46.905521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:46.912730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:46.913217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:46.913648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:46.914352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:46.914796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:46.915213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:47.060505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:47.069495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:47.070943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:47.072205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba7fc481-918c-490a-85b7-210d4f99aa56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.171858 Aug 31 12:21:47.073648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 237/459] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:47.832778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:47.833556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:47.840701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:47.841178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:47.841606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:47.842696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:47.842921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:47.844023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:48.042360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:48.051896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a63d3192-e9f1-48c3-8ed8-dbdf7e4e515b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.222961 Aug 31 12:21:48.055079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 238/460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:48.098605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:48.099200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:48.105938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:48.106513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:48.106929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:48.107653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:48.108103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:48.108518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:48.259206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:48.268683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:48.270286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:48.272502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-31dd7920-cc5a-4e9d-9c1e-17b2a543d8e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.178021 Aug 31 12:21:48.273282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 239/461] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:49.077475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:49.079339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:49.087397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:49.088413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:49.088413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:49.089002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:49.089455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:49.089869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:49.267882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:49.277090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-381223d2-64ff-4cf0-a0c7-1774c60531cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.205716 Aug 31 12:21:49.279459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 240/462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:49.298938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:49.299749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:49.308061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:49.308557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:49.308979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:49.309680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:49.310122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:49.310534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:49.486145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:49.496352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:49.498245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:49.508430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d7a7651c-e381-4b4e-8fab-4642a808c8c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.205363 Aug 31 12:21:49.508430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 241/463] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:50.302672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:50.304306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:50.314436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:50.315167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:50.315896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:50.316931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:50.317619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:50.318387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:50.499927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:50.509496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-129f13bb-2338-405f-8189-1d917d7b06d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.213373 Aug 31 12:21:50.510100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 242/464] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:50.524598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:50.525195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:50.531611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:50.532104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:50.532588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:50.533275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:50.533713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:50.534150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:50.682644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:50.692294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:50.693955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:50.695185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e48f1f8a-2038-4c21-9777-4281e42e5452 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.174951 Aug 31 12:21:50.695779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 243/465] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:51.535267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:51.536132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:51.544402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:51.544887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:51.545307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:51.546007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:51.546451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:51.546860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:51.726559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:51.737019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-542ec1db-73cf-4fd3-a91d-b546d13003d4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.206486 Aug 31 12:21:51.737615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 244/466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:51.743314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:51.743932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:51.751572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:51.752078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:51.752509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:51.753773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:51.754430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:51.755381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:51.914696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:51.924611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:51.926059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:51.927324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f098f9b-bfac-43f2-ae04-1d6b7bf8ba46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.188670 Aug 31 12:21:51.928181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 245/467] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:52.760897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:52.761663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:52.768864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:52.769462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:52.769894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:52.770610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:52.771737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:52.772372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:52.980068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:52.993901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3ba9a295-c2a5-4926-b052-ab996b2193a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.237072 Aug 31 12:21:52.994520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 246/468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:21:52.999913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:53.000525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:53.008478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:53.009386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:53.009898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:53.010197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:53.010643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:53.011310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:53.188648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:53.204961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:53.207971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:53.210169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ec52ca9-2129-4375-8894-cc8afc2fca5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.214361 Aug 31 12:21:53.211144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 247/469] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:54.018203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:54.019325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:54.029175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:54.029884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:54.030518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:54.031601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:54.032281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:54.032914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:54.054699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:54.197412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:54.206088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2760b74c-705e-4f76-a488-d1a47e8794a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1758 microversion: 2.1 time: 0.192620 Aug 31 12:21:54.206659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 248/470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:54.251805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:54.252429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:54.259961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:54.260601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:54.261137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:54.262073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:54.262643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:54.263171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:54.412771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:54.422488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:54.423834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:54.425025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-df9b0460-d333-422b-a422-b9bc46542bc0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.178000 Aug 31 12:21:54.425577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 249/471] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:54.430478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=23 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:54.511509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:54.936984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-31fb5fae-6642-4bbd-9816-4870c372ee19 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "POST /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.526575 Aug 31 12:21:54.938009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 223/472] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:21:44 2022] POST /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8/os-volume_attachments => generated 194 bytes in 10528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:21:55.228317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:55.229031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:55.236577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:55.237102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:55.237712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:55.238671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:55.239126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:55.239621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:55.446365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:55.451514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:55.452823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:55.456681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-042206fa-5316-4a91-aa09-28f1360277b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1761 microversion: 2.1 time: 0.232492 Aug 31 12:21:55.457262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 250/473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:21:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1761 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:21:55.466584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:55.468148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:55.469177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:55.470477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:55.471603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:55.473404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:55.633465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:55.643505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:55.644940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:55.646276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6186b9aa-dd44-4bea-bcd1-d9de22d5ee3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.201158 Aug 31 12:21:55.646961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 224/474] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:21:56.669775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:56.670409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:56.678535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:56.679019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:56.679402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:56.680306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:56.680578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:56.681001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:56.827420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:56.837432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:56.838896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:56.840121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c35cfe55-885d-4d13-8437-ecb9f9738938 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.174767 Aug 31 12:21:56.840690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 251/475] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:57.869064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:57.870198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:57.881057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:57.881663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:57.882100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:57.882810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:57.883260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:57.883692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:58.041936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:58.056451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:58.058682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:58.060614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-62dc0c10-2024-4c8b-995a-5c13fb65ea66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.198169 Aug 31 12:21:58.061514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 225/476] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:21:59.094406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:21:59.095560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:21:59.109952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:59.111170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:59.111911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:59.113006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:21:59.113700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:21:59.114683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:21:59.271795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:59.281952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:59.283497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:21:59.284763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-632039c9-1a79-40c1-9049-1b9bcafc4fae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.199518 Aug 31 12:21:59.285560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 252/477] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:21:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:00.311787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:00.312394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:00.319469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:00.319963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:00.320399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:00.321103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:00.321552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:00.321971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:00.467268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:00.477882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:00.479342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:00.480554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef1643d4-efa3-4738-92ca-10b8b230927b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.172719 Aug 31 12:22:00.481082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 226/478] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:22:01.507774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:01.508718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:01.519539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:01.520305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:01.521025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:01.521740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:01.522268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:01.522699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:01.676501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:01.690092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:01.691553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:01.692891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f69d4e7a-a548-4d17-9b97-e6f2b2d77cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.191023 Aug 31 12:22:01.693564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 253/479] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:02.717786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:02.718371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:02.726244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:02.726650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:02.727098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:02.727954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:02.728471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:02.728907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:02.899775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:02.908771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:02.910239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:02.912209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae848636-7abc-4a48-939c-4d98eab0e96e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.198009 Aug 31 12:22:02.912778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 227/480] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:03.944367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:03.945672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:03.952876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:03.953357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:03.953781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:03.954484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:03.954955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:03.955369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:04.100557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:04.111746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:04.114005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:04.117298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-acf418c5-663c-437f-8185-025f9032463a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.176160 Aug 31 12:22:04.118347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 254/481] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:05.144856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:05.145524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:05.152302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:05.152779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:05.153207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:05.153889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:05.154329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:05.154745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:05.299723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:05.309793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:05.311526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:05.312387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe6cf373-bf0c-4757-bbbc-d07d154af77b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.171531 Aug 31 12:22:05.312979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 228/482] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:06.337411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:06.338037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:06.340367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:06.345705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:06.346174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:06.346600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:06.347307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:06.347754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:06.348168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:06.502136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:06.516600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:06.518974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:06.520753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7af421a2-8f5b-47ab-99c5-629071a00ad8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.187204 Aug 31 12:22:06.521617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 255/483] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:07.552661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:07.553299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:07.560670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:07.561164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:07.561606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:07.562328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:07.562790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:07.563214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:07.747885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:07.765101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:07.767628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:07.769597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4c2108b-1c5a-458e-a205-c3cff5709174 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.221568 Aug 31 12:22:07.770541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 229/484] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:08.806784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:08.807433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:08.814069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:08.814556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:08.815091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:08.815825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:08.816288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:08.816713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:08.956475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:08.965780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:08.967210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:08.968403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-39e07255-d9a1-4f2f-8b22-d9045ad701d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.165704 Aug 31 12:22:08.968960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 256/485] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:09.992516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:09.993114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:10.000298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:10.000787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:10.001221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:10.001920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:10.002370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:10.002792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:10.142113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:10.158408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:10.162508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:10.164616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-156e3c72-d570-4dce-8356-6030559e4a2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.176028 Aug 31 12:22:10.165572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 230/486] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:10.402713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-53e62b21-da5c-4fa5-9108-d145e4e9388f req-b386a502-1636-4644-9cdf-be437b450818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "name": "network-vif-plugged", "status": "completed", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:10.414942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-53e62b21-da5c-4fa5-9108-d145e4e9388f req-b386a502-1636-4644-9cdf-be437b450818 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:10.415248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-53e62b21-da5c-4fa5-9108-d145e4e9388f req-b386a502-1636-4644-9cdf-be437b450818 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:10.415695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-53e62b21-da5c-4fa5-9108-d145e4e9388f req-b386a502-1636-4644-9cdf-be437b450818 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:10.430312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-53e62b21-da5c-4fa5-9108-d145e4e9388f req-b386a502-1636-4644-9cdf-be437b450818 service nova] Creating event network-vif-plugged:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:22:10.435746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-53e62b21-da5c-4fa5-9108-d145e4e9388f req-b386a502-1636-4644-9cdf-be437b450818 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037074 Aug 31 12:22:10.436355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 257/487] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:11.191010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:11.191745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:11.200701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:11.201247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:11.201664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:11.202364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:11.202861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:11.203469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:11.362108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:11.371492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:11.373176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:11.374550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-120cad51-40c4-4076-9fcd-65736c301e5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.188004 Aug 31 12:22:11.375678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 231/488] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:12.397820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:22:12.398317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:22:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:22:12.404783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:12.405588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:12.422118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:12.422401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:12.422840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:12.423841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:12.424306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:12.424707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:12.561345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:12.574472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:12.576735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:12.578504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cc103a7d-0645-4277-9ce4-396bd2aec37b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.182006 Aug 31 12:22:12.579173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 258/489] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:13.602136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:13.602703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:13.609833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:13.610316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:13.610743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:13.611785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:13.611920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:13.612330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:13.767721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:13.777535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:13.778952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:13.780265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b6f8b1ad-a731-49ee-9819-8278fb73df98 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.182374 Aug 31 12:22:13.780824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 232/490] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:14.806439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:14.807065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:14.816396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:14.817166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:14.817758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:14.818801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:14.819636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:14.820437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:14.970446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:14.979796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:14.981224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:14.982385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4f10891-7002-4681-9bbf-c948cadc4d4d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.181758 Aug 31 12:22:14.982979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 259/491] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:16.008945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:16.009516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:16.016418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:16.016904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:16.017343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:16.018040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:16.018491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:16.018919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:16.161987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:16.171746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:16.173194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:16.174414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-827e2762-8b63-4598-87f6-969a5a1312eb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1806 microversion: 2.20 time: 0.169503 Aug 31 12:22:16.174987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 233/492] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:17.200214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:17.200791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:17.209642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:17.210172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:17.210587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:17.211277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:17.211757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:17.212179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:17.362781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:17.371849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:17.373599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:17.375035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3dceca75-7a21-456e-b105-870f067f0d70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1793 microversion: 2.20 time: 0.180537 Aug 31 12:22:17.375722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 260/493] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:22:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1793 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:22:19.983016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:19.983587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:19.990460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:19.990932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:19.991402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:19.992110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:19.992564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:19.992975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:20.123746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lazy-loading 'services' on Instance uuid ca1cc2e2-509e-4bf7-a56f-28002021cda8 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:22:20.259148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-95460cc6-87a0-48a5-b696-5430e993cd05 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8/os-volume_attachments/e5313ff0-9c21-4ddb-85b0-57f3cf913855" status: 202 len: 0 microversion: 2.1 time: 0.279998 Aug 31 12:22:20.259963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 234/494] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:22:19 2022] DELETE /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8/os-volume_attachments/e5313ff0-9c21-4ddb-85b0-57f3cf913855 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:22:21.388394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:21.388957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:21.396127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:21.396614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:21.397047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:21.397731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:21.398182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:21.398605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:21.426901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:22:21.515812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7bf28421-2b7c-4e98-ab29-551033908186 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 204 len: 0 microversion: 2.1 time: 0.130463 Aug 31 12:22:21.516685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 261/495] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:22:21 2022] DELETE /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:22:21.531472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:21.532412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:21.538891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:21.539398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:21.539827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:21.540538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:21.540979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:21.541410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:21.688736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:21.698898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-71bb1ef9-f661-4fe9-b4d9-6c058a3f8ccb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1513 microversion: 2.1 time: 0.174309 Aug 31 12:22:21.699638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 235/496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:21 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:22.723487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:22.724311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:22.731556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:22.731942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:22.732405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:22.733101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:22.733541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:22.733955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:22.885730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:22.893869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99007f21-f69a-4ee4-8f74-196789d898c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1513 microversion: 2.1 time: 0.174858 Aug 31 12:22:22.894500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 262/497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:22 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:23.916494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:23.917644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:23.925260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:23.925896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:23.926328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:23.927022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:23.927629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:23.928092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:24.033501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:24.042481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-716cbc77-3aef-48fb-8318-fece47936b4e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 200 len: 1471 microversion: 2.1 time: 0.130401 Aug 31 12:22:24.043076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 236/498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:23 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 1471 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:24.092060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-85204090-ce9a-4f0b-910b-33c4f3662b5d req-60dd4c5c-1d06-433b-888c-491638ef3f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cc2e2-509e-4bf7-a56f-28002021cda8", "name": "network-vif-deleted", "tag": "f298c8bf-7f0e-415b-9af7-b4dc0033bf36"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:24.102412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-85204090-ce9a-4f0b-910b-33c4f3662b5d req-60dd4c5c-1d06-433b-888c-491638ef3f16 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:24.102871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-85204090-ce9a-4f0b-910b-33c4f3662b5d req-60dd4c5c-1d06-433b-888c-491638ef3f16 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:24.103320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-85204090-ce9a-4f0b-910b-33c4f3662b5d req-60dd4c5c-1d06-433b-888c-491638ef3f16 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:24.107247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:24.116175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-85204090-ce9a-4f0b-910b-33c4f3662b5d req-60dd4c5c-1d06-433b-888c-491638ef3f16 service nova] Creating event network-vif-deleted:f298c8bf-7f0e-415b-9af7-b4dc0033bf36 for instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 on hv-cinder-85535 Aug 31 12:22:24.122548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-85204090-ce9a-4f0b-910b-33c4f3662b5d req-60dd4c5c-1d06-433b-888c-491638ef3f16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034876 Aug 31 12:22:24.123178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 263/499] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:25.065738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:25.066707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: ca1cc2e2-509e-4bf7-a56f-28002021cda8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:25.069791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=27 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:25.075743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:25.076230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:25.076677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:25.077361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:25.077821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:25.078242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:25.081171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:25.096157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] HTTP exception thrown: Instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 could not be found. Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Request method failure captured: Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 HTTP/1.1 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1Ii6UGtowYdS2GObkmobv55jEzCJXUlwz4Svacaer_15A5SQFYG-UL8aG5EU2Hj-_-8fUP0aPlN9pizi2thoczSCcJtKeYi4KMhiWTg-odxJ0RZCw00NMoW4Xh5qrf91PsXi1IqS3us-SnJLcGR0ec3po9ECgiXWlhvjJvJHiB_hj8 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: a34eb3e0aba44efb8ddafedd89df4060 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotTestJSON-88791795 Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:22:25.098271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34eb3e0aba44efb8ddafedd89df4060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a34eb3e0aba44efb8ddafedd89df4060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a34eb3e0aba44efb8ddafedd89df4060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a34eb3e0aba44efb8ddafedd89df4060", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotTestJSON-88791795 Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: a34eb3e0aba44efb8ddafedd89df4060 Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-88791795 Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotTestJSON-88791795-project Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 37a3870e9df04d7795a649a21b722801 Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotTestJSON-88791795-project Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 could not be found. Aug 31 12:22:25.099895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'ca1cc2e2-509e-4bf7-a56f-28002021cda8'} Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 could not be found. Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:22:25.100824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 could not be found. Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 could not be found. Aug 31 12:22:25.102334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:25.104181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Returning 404 to user: Instance ca1cc2e2-509e-4bf7-a56f-28002021cda8 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:22:25.104181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c61d5a72-6495-4dd3-90b6-f523d69f90b5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8" status: 404 len: 111 microversion: 2.1 time: 0.039695 Aug 31 12:22:25.104181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 237/500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:25 2022] GET /compute/v2.1/servers/ca1cc2e2-509e-4bf7-a56f-28002021cda8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:22:31.850974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:31.851945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:31.862319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:31.866156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:31.866156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:31.866156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:31.866695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:31.867346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:31.908486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-59744a66-e838-4ee3-b9f2-e75bd3928643 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/ips" status: 200 len: 150 microversion: 2.1 time: 0.063548 Aug 31 12:22:31.909340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 264/501] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:22:31 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/ips => generated 150 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:31.929790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "856d9cff-7622-4c18-9008-e074f71c27b8"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:31.933415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:31.947685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:31.948214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:31.948659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:31.949327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:31.949906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:31.950202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:32.065146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Invalid volume: volume 856d9cff-7622-4c18-9008-e074f71c27b8 is already attached to instances: 991ff4bb-6c07-4c69-b673-272a1e178100 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/os-volume_attachments HTTP/1.1 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 74 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:22:32.067359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "856d9cff-7622-4c18-9008-e074f71c27b8"}} Aug 31 12:22:32.069757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Invalid volume: volume 856d9cff-7622-4c18-9008-e074f71c27b8 is already attached to instances: 991ff4bb-6c07-4c69-b673-272a1e178100 Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'server_id': 'fa04fef6-94a1-4065-a428-01e95e76cdf4', 'body': {'volumeAttachment': {'volumeId': '856d9cff-7622-4c18-9008-e074f71c27b8'}}} Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 856d9cff-7622-4c18-9008-e074f71c27b8 is already attached to instances: 991ff4bb-6c07-4c69-b673-272a1e178100 Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:32.071527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 856d9cff-7622-4c18-9008-e074f71c27b8 is already attached to instances: 991ff4bb-6c07-4c69-b673-272a1e178100 Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:32.073690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 856d9cff-7622-4c18-9008-e074f71c27b8 is already attached to instances: 991ff4bb-6c07-4c69-b673-272a1e178100 Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 400 to user: Invalid volume: volume 856d9cff-7622-4c18-9008-e074f71c27b8 is already attached to instances: 991ff4bb-6c07-4c69-b673-272a1e178100 {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-acc1a399-570f-4c43-9a7e-0cd2d524154b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145964 Aug 31 12:22:32.076027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 238/502] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:22:31 2022] POST /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:22:32.078420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:32.078992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:32.086916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:32.087461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:32.087957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:32.088950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:32.089414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:32.089839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:32.120899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:22:32.352682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee50076a-1d23-4947-b6fb-3886dc585eaa tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 204 len: 0 microversion: 2.1 time: 0.277898 Aug 31 12:22:32.353163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 265/503] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:22:32 2022] DELETE /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:22:32.363548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:32.364206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:32.373591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:32.374159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:32.374599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:32.375427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:32.375894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:32.376320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:32.546375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:32.559813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b9908d7a-3247-4b49-ab64-28157ef8113e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1681 microversion: 2.1 time: 0.200915 Aug 31 12:22:32.560406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 239/504] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:32 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:33.588217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:33.588217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:33.600007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:33.600840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:33.601802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:33.603053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:33.603661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:33.604352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:33.798759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:33.808064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07cd4fa1-abe6-41f9-8165-503dc2032a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1681 microversion: 2.1 time: 0.228665 Aug 31 12:22:33.808631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 266/505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:33 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:34.224903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-31868992", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "networks": [{"uuid": "e2cce7b5-4996-4066-9026-8abd05d477be"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:34.320336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] validate_networks() for [('e2cce7b5-4996-4066-9026-8abd05d477be', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:22:34.836110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:22:34.836778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:22:34.837587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:22:34.838553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:22:34.839154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:22:34.844896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:34.845969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:34.853444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:34.853961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:34.854457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:34.854633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:34.855269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:34.855467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:34.855896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:34.856077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:34.856470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:34.856902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:34.857523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:34.858054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:34.878978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Getting quotas for project a34eb3e0aba44efb8ddafedd89df4060. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:22:34.885007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Getting quotas for user 37a3870e9df04d7795a649a21b722801 and project a34eb3e0aba44efb8ddafedd89df4060. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:22:34.901448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:22:34.904191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:22:34.964700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c6ff018d-6217-4c15-ba26-b9af4b0b1d15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743917 Aug 31 12:22:34.965822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 240/506] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:22:34.978831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c74f3a77-8fbe-465c-becb-06d2a2a835ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:34.979528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c74f3a77-8fbe-465c-becb-06d2a2a835ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:35.045641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c74f3a77-8fbe-465c-becb-06d2a2a835ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:35.057132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c74f3a77-8fbe-465c-becb-06d2a2a835ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1217 microversion: 2.1 time: 0.081216 Aug 31 12:22:35.057303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 241/507] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:35.083939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:35.092660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-933d4994-2605-469e-8557-92ef6814d0d4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1681 microversion: 2.1 time: 0.254266 Aug 31 12:22:35.093612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 267/508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:34 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:36.095282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:36.096391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:36.106650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:36.107411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:36.108050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:36.109091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:36.109748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:36.110482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:36.130161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:36.131753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:36.139016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:36.140010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:36.140457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:36.141434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:36.141935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:36.142366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:36.488705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:36.497746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ba96b47f-22f7-4dbd-8466-bd8ee5211b00 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1269 microversion: 2.1 time: 0.410222 Aug 31 12:22:36.498320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 242/509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:36 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1269 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:36.503613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "268124ef-b0ac-4c13-9f73-92bd4a8ec220"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:36.506277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:36.514509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:36.514885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:36.516426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:36.516426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:36.517084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:36.518363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:36.768092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:36.776729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d696bc9c-cd9d-49b2-b539-c8b0017826d9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1681 microversion: 2.1 time: 0.653854 Aug 31 12:22:36.777363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 268/510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:36 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1681 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:36.915640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7704e027-4386-440b-a350-a1ab1d31f7af tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415973 Aug 31 12:22:36.923022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 243/511] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:22:36 2022] POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:37.529215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:37.530076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:37.534710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:37.540988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:37.541503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:37.542468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:37.543221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:37.543909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:37.544331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:37.710587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:37.727856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76353b05-bcaf-42cf-be24-a5ae2db55bb9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1275 microversion: 2.1 time: 0.203207 Aug 31 12:22:37.728830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 269/512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:37 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:37.755356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-13bb92a0-bf9a-432c-ae54-eb48a597b350 req-e82a181c-2e49-492d-b647-f487d0c4ccf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa04fef6-94a1-4065-a428-01e95e76cdf4", "name": "network-vif-deleted", "tag": "5c79a0d4-e20a-4833-b8e1-9ea66396c0a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:37.774341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-13bb92a0-bf9a-432c-ae54-eb48a597b350 req-e82a181c-2e49-492d-b647-f487d0c4ccf4 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:37.775255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-13bb92a0-bf9a-432c-ae54-eb48a597b350 req-e82a181c-2e49-492d-b647-f487d0c4ccf4 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:37.775944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-13bb92a0-bf9a-432c-ae54-eb48a597b350 req-e82a181c-2e49-492d-b647-f487d0c4ccf4 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:37.803941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:37.807352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:37.814913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-13bb92a0-bf9a-432c-ae54-eb48a597b350 req-e82a181c-2e49-492d-b647-f487d0c4ccf4 service nova] Creating event network-vif-deleted:5c79a0d4-e20a-4833-b8e1-9ea66396c0a2 for instance fa04fef6-94a1-4065-a428-01e95e76cdf4 on hv-cinder-85535 Aug 31 12:22:37.830171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:37.834381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:37.835884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-13bb92a0-bf9a-432c-ae54-eb48a597b350 req-e82a181c-2e49-492d-b647-f487d0c4ccf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093562 Aug 31 12:22:37.842770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 244/513] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:37.848369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:37.850944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:37.853105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:37.858667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:38.000100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:38.014340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ada21ab4-65d1-4949-b73a-ee7e6fba0a72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 200 len: 1326 microversion: 2.1 time: 0.217642 Aug 31 12:22:38.027353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 270/514] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:37 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:38.764829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:38.770084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:38.789397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:38.796952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:38.802293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:38.803990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:38.806028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:38.808021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:39.053669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:39.056737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:39.077152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:39.078081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:39.078849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:39.080219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:39.081158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:39.081834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:39.104733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 HTTP/1.1 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:22:39.107891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:22:39.109511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'fa04fef6-94a1-4065-a428-01e95e76cdf4'} Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:22:39.110424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:22:39.111860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:39.114838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:22:39.115998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-94a9ff72-d20e-4f6a-9fd0-4561005e6c4d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 404 len: 111 microversion: 2.1 time: 0.072230 Aug 31 12:22:39.121148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 271/515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:39 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:22:39.139912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eeb16bed-d0b4-4980-8fe3-45c26f4cddae tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '.version_select at 0x7fe855b1caf0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:39.189811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eeb16bed-d0b4-4980-8fe3-45c26f4cddae tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701752175" status: 202 len: 0 microversion: 2.1 time: 0.066453 Aug 31 12:22:39.191003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 272/516] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 31 12:22:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701752175 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:22:39.395307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:39.411203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3f5144d0-fc6d-4842-b9af-1d10b6ccaf8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.656594 Aug 31 12:22:39.428072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 245/517] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:40.105992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-ea672971-a3e7-47c1-bd34-0b552d27d101 req-1f195bb4-7b70-421d-b79d-c103480be48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f08033a-e077-4eec-8c66-7ee2b37678a8", "tag": "2425ea5c-c7cd-4101-8bc9-7d903289d925"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:40.150914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-ea672971-a3e7-47c1-bd34-0b552d27d101 req-1f195bb4-7b70-421d-b79d-c103480be48a service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:40.151994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-ea672971-a3e7-47c1-bd34-0b552d27d101 req-1f195bb4-7b70-421d-b79d-c103480be48a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:40.153093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-ea672971-a3e7-47c1-bd34-0b552d27d101 req-1f195bb4-7b70-421d-b79d-c103480be48a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:40.187400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-ea672971-a3e7-47c1-bd34-0b552d27d101 req-1f195bb4-7b70-421d-b79d-c103480be48a service nova] Creating event network-changed:2425ea5c-c7cd-4101-8bc9-7d903289d925 for instance 8f08033a-e077-4eec-8c66-7ee2b37678a8 on hv-cinder-85535 Aug 31 12:22:40.200423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-ea672971-a3e7-47c1-bd34-0b552d27d101 req-1f195bb4-7b70-421d-b79d-c103480be48a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114620 Aug 31 12:22:40.207524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 273/518] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:40.447473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:40.449530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:40.466965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:40.468187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:40.469165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:40.472228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:40.474255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:40.482119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:40.741138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:40.741904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:40.750138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:40.751110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:40.751706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:40.752674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:40.753435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:40.755410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:40.981072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lazy-loading 'services' on Instance uuid 991ff4bb-6c07-4c69-b673-272a1e178100 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:22:41.123274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:41.150346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9db32b1c-757c-4a91-9ba8-cfdfb97e52a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.711386 Aug 31 12:22:41.151143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 246/519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:40 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:41.200667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76bb834a-d44f-4443-9bdb-4c07fee6f567 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments/856d9cff-7622-4c18-9008-e074f71c27b8" status: 202 len: 0 microversion: 2.1 time: 0.468470 Aug 31 12:22:41.202048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 274/520] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:22:40 2022] DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments/856d9cff-7622-4c18-9008-e074f71c27b8 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:22:41.220923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:41.224094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:41.238144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:41.239624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:41.240685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:41.242335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:41.243191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:41.244072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:41.309957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-54b30b75-e020-4ff1-80e0-14c9cbb0bbf6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093609 Aug 31 12:22:41.312035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 247/521] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:22:41 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:42.179869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:42.180669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:42.188772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:42.189330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:42.190010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:42.191123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:42.191809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:42.192329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:42.331168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:42.334973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:42.346556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:42.347443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:42.348206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:42.349509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:42.350171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:42.350745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:42.381861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:42.395082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fefcc5dc-b24e-4d2b-aa4e-c39181622664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.220694 Aug 31 12:22:42.395731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 275/522] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:42 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:42.416932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26f423b2-723e-4f20-b3cf-9d902f152565 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089694 Aug 31 12:22:42.416932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 248/523] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:22:42 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:43.432860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:43.436004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:43.437397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:43.440962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:43.455129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:43.455768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:43.457010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:43.457756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:43.458275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:43.459730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:43.459928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:43.460061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:43.460184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:43.460305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:43.460639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:43.460786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:43.523020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9b2e584c-6f8f-49ed-af10-92772ac67048 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092133 Aug 31 12:22:43.523848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 249/524] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:22:43 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:43.679744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:43.701615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-71ac8df7-592e-442f-916f-db9b1d1260c9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.277920 Aug 31 12:22:43.702784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 276/525] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:43 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:44.541875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:44.549808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:44.572096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:44.573333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:44.574419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:44.576345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:44.577430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:44.578431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:44.648180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15da3765-8bc6-462f-8377-37644abef750 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114316 Aug 31 12:22:44.652514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 250/526] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:22:44 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:44.738455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:44.739096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:44.748944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:44.749879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:44.750516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:44.752003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:44.753112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:44.753855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.005824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:45.009693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:45.014974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:45.026765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.026765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.027070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:45.027281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.027281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.027281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.028144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.033323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-84bf3fdc-9638-443a-8e21-500b79c6bfd3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.300509 Aug 31 12:22:45.034705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 277/527] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:44 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:45.061999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=8 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:45.083495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'flavor' on Instance uuid aef8f7f2-486d-4c5d-984f-55bda8e6fbda {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:22:45.273958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1b75ba8d-7edb-4ac0-be16-11289df7fdf2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action" status: 200 len: 32 microversion: 2.1 time: 0.274771 Aug 31 12:22:45.274481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 251/528] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:22:44 2022] POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action => generated 32 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 12:22:45.285744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:45.286196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:45.294397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.294896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.295621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.296297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.296747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.297264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.572971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:45.589412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-944bff1a-3d94-4823-a3ed-9b322bf82f4f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.308041 Aug 31 12:22:45.590406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 278/529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:45.679645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:45.682932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:45.691283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.692244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.692695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.694150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.694699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.695199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.743196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-473192cd-7997-405c-8c78-09db82719af5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076431 Aug 31 12:22:45.744328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 252/530] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:22:45 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:22:45.838231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:45.838231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:45.838881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.839425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.839981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.840858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:45.841527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:45.841949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:45.899069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:22:45.963373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:46.041574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d1915069-deaa-4898-928b-035a99a9b9ea tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 204 len: 0 microversion: 2.1 time: 0.214914 Aug 31 12:22:46.042547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 279/531] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:22:45 2022] DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:22:46.052707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:46.053540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:46.064356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:46.065335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:46.066112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:46.067001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:46.067666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:46.068236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:46.069724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:46.072152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:46.088679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:46.089735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:46.091598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:46.091806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:46.093132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:46.094477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:46.095262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:46.382291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:46.394171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-36f57f52-ba60-4632-a8e9-b27ce378e4fc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1684 microversion: 2.1 time: 0.345748 Aug 31 12:22:46.394801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 253/532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:46 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1684 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:46.401546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:46.410216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-548c44d0-162d-4bf1-89af-48ebaa9b8cdb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.351669 Aug 31 12:22:46.410808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 280/533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:46 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:46.616064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:46.617099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:46.625555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:46.626454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:46.627062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:46.627992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:46.629177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:46.630185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:46.794549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:46.805780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2b7e694-189b-4b80-ac7f-e838e48ba08b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.194701 Aug 31 12:22:46.806618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 254/534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:47.422924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:47.424554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:47.433441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:47.434278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:47.437635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.438403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.438890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:47.439810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.440415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.441041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:47.445073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.447037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.447037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:47.448048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.448841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.449591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:47.778198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:47.787553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a8fc1a6a-0943-48d4-a980-fb5eb2bbd479 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1684 microversion: 2.1 time: 0.371661 Aug 31 12:22:47.788451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 281/535] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:47 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1684 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:47.794412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:47.799205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d464be58-8d53-4143-8dde-a31e65223c24 req-905335bc-cd9e-4f3c-bb72-23400970b3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f08033a-e077-4eec-8c66-7ee2b37678a8", "name": "network-vif-plugged", "status": "completed", "tag": "2425ea5c-c7cd-4101-8bc9-7d903289d925"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:47.808845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8313227e-261e-4049-a572-0d80b9a08c34 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.379002 Aug 31 12:22:47.809784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 255/536] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:47 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:47.813808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d464be58-8d53-4143-8dde-a31e65223c24 req-905335bc-cd9e-4f3c-bb72-23400970b3b3 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.814284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d464be58-8d53-4143-8dde-a31e65223c24 req-905335bc-cd9e-4f3c-bb72-23400970b3b3 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.815026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d464be58-8d53-4143-8dde-a31e65223c24 req-905335bc-cd9e-4f3c-bb72-23400970b3b3 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:47.827693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d464be58-8d53-4143-8dde-a31e65223c24 req-905335bc-cd9e-4f3c-bb72-23400970b3b3 service nova] Creating event network-vif-plugged:2425ea5c-c7cd-4101-8bc9-7d903289d925 for instance 8f08033a-e077-4eec-8c66-7ee2b37678a8 on hv-cinder-85535 Aug 31 12:22:47.833637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d464be58-8d53-4143-8dde-a31e65223c24 req-905335bc-cd9e-4f3c-bb72-23400970b3b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043524 Aug 31 12:22:47.834251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 282/537] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:47.836046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:47.841450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:47.849725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.850646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.850646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:47.851348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:47.852385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:47.852385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:48.158879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:48.171459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0011cf8-4ed9-49d1-ace6-baf3be71abc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.341465 Aug 31 12:22:48.172349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 256/538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:48.811891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:48.812751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:48.821478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:48.822117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:48.822560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:48.823350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:48.824373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:48.824373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:48.842613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:48.845081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:48.852199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:48.852813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:48.853409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:48.854138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:48.854780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:48.855406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:48.957183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:48.965990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4aa86a0e-b674-4760-8c90-91a846e5bc2e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1616 microversion: 2.1 time: 0.158453 Aug 31 12:22:48.966814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 283/539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:48 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1616 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:49.125913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:49.142190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7237df2-ff8a-460e-9639-f9488e8bedfb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1317 microversion: 2.1 time: 0.303952 Aug 31 12:22:49.143674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 257/540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:48 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:49.203930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:49.208258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:49.219518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:49.220884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:49.221155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:49.222348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:49.223107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:49.224043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:49.341736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-912c1875-da8a-4bda-9ce3-5150dd3858ab req-1d9d053a-5943-4e2e-b426-aba90ba863c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991ff4bb-6c07-4c69-b673-272a1e178100", "name": "network-vif-deleted", "tag": "db14b681-db73-4b8e-b264-f17550194eec"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:49.362522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-912c1875-da8a-4bda-9ce3-5150dd3858ab req-1d9d053a-5943-4e2e-b426-aba90ba863c9 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:49.363298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-912c1875-da8a-4bda-9ce3-5150dd3858ab req-1d9d053a-5943-4e2e-b426-aba90ba863c9 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:49.364560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-912c1875-da8a-4bda-9ce3-5150dd3858ab req-1d9d053a-5943-4e2e-b426-aba90ba863c9 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:49.392786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-912c1875-da8a-4bda-9ce3-5150dd3858ab req-1d9d053a-5943-4e2e-b426-aba90ba863c9 service nova] Creating event network-vif-deleted:db14b681-db73-4b8e-b264-f17550194eec for instance 991ff4bb-6c07-4c69-b673-272a1e178100 on hv-cinder-85535 Aug 31 12:22:49.403880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-912c1875-da8a-4bda-9ce3-5150dd3858ab req-1d9d053a-5943-4e2e-b426-aba90ba863c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070185 Aug 31 12:22:49.406467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 258/541] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:49.465530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:49.479464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f659d39b-91f6-4c74-a567-3e702b16ea5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.283662 Aug 31 12:22:49.480238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 284/542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:49.994327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:50.003428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:50.011179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.012015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.012998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.014078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.014797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.015495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.077910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.077910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.077910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.077910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lazy-loading 'fault' on Instance uuid 991ff4bb-6c07-4c69-b673-272a1e178100 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:22:50.152126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:50.169514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c17ebcaa-bf93-443c-ad0f-4b9442ef3881 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 200 len: 1332 microversion: 2.1 time: 0.179343 Aug 31 12:22:50.171219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 259/543] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:49 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:50.175865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:50.178074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:50.189433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.190266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.191150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.192182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.192855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.193470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.430443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:50.440591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-86d07f47-02ec-4802-8549-99870e9cae99 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1506 microversion: 2.1 time: 0.273050 Aug 31 12:22:50.441191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 285/544] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:50 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:50.468696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bfa22da-28dc-4a7c-bb98-63d14c4ed246", "device": "/dev/sdb"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:50.472140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:50.482333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.482955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.483528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.484716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.485493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.486231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.511301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:50.512697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:50.523777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.524709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.525146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.525958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:50.526408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:50.526827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:50.764162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:50.798224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-33ae30ea-632e-4ede-9b42-8f64dd38b4fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.292418 Aug 31 12:22:50.818375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 286/545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:50.956939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dfbade71-4b73-4a67-961c-91a0e3a51026 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "POST /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491987 Aug 31 12:22:50.963835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 260/546] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:22:50 2022] POST /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:22:51.197030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:51.198105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:51.207454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:51.207454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:51.207954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:51.209142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:51.209905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:51.210614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:51.227491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 HTTP/1.1 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:22:51.229166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:22:51.230735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '991ff4bb-6c07-4c69-b673-272a1e178100'} Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:22:51.231927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:22:51.233345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:22:51.234901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:22:51.234901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09993e96-c925-40ff-ba4c-5d6940ae6759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 404 len: 111 microversion: 2.1 time: 0.037597 Aug 31 12:22:51.234901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 287/547] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:51 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:22:51.247726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80d33852-4d50-4f0d-a97c-14e19efe3f36 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '.version_select at 0x7fe854f310d0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:51.277711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80d33852-4d50-4f0d-a97c-14e19efe3f36 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376571893" status: 202 len: 0 microversion: 2.1 time: 0.038434 Aug 31 12:22:51.278606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 261/548] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 31 12:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376571893 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:22:51.843374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:51.844012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:51.858621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:51.859542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:51.860166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:51.861518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:51.863027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:51.863753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:52.261027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:52.278101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b221036-ce25-472f-bd4f-4bf193d708b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.440174 Aug 31 12:22:52.279542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 288/549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:52.565108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26ac2cb6-0103-4971-9016-c28c6cb1fb0f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: .version_select at 0x7fe854ea0d30>, body: {"keypair": {"name": "tempest-keypair-1334419835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0kAQl0p9A7MTDdk1OSrDtRszOI+GcISmoxTrJ261++UDpRLfZSSjmzrxry2ToYNuZz3/fqaty7UjY5uNZ/XErk7EWPGdR+cpALRmoKlLnancLvWOoHfU3gk4gRpM9P4A=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:52.585729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-26ac2cb6-0103-4971-9016-c28c6cb1fb0f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:22:52.591838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-26ac2cb6-0103-4971-9016-c28c6cb1fb0f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:22:52.625594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26ac2cb6-0103-4971-9016-c28c6cb1fb0f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067657 Aug 31 12:22:52.626119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 262/550] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:22:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:22:53.309063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:53.309735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:53.328377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:53.329209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:53.329790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:53.331010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:53.331646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:53.332216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:53.859874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:53.876783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-183676a3-8e4e-4f65-8585-178303cbd383 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.573073 Aug 31 12:22:53.878233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 289/551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:54.340794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-442164783", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72511f19-18eb-4ec4-87f2-a581216ea81a"}], "security_groups": [{"name": "tempest-securitygroup--990747623"}], "key_name": "tempest-keypair-1334419835", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:54.472311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] validate_networks() for [('72511f19-18eb-4ec4-87f2-a581216ea81a', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:22:54.904810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:54.905746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:54.913993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:54.914487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:54.914919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:54.915678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:54.916442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:54.916860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:54.932458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:22:54.932914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:22:54.933737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:22:54.934226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:22:54.934771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:22:54.946519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:54.947052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:54.947545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:54.948283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:54.948816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:54.949143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:54.968669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:22:54.973557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:22:54.989715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:22:54.992274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:22:55.048518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80abe07c-d7e4-47e3-96d8-a88782b0b75a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712640 Aug 31 12:22:55.055854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 263/552] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:22:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:22:55.065532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ac764dd-0648-4fae-bcb9-04b51ab63ad2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:55.065532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3ac764dd-0648-4fae-bcb9-04b51ab63ad2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:55.069671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:55.091160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:55.101048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-02108bdb-a3c2-4b24-8e52-7298e08c921f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.200275 Aug 31 12:22:55.102112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 290/553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:55.157435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3ac764dd-0648-4fae-bcb9-04b51ab63ad2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:55.165375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3ac764dd-0648-4fae-bcb9-04b51ab63ad2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1241 microversion: 2.1 time: 0.108002 Aug 31 12:22:55.166284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 264/554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:55 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:56.137699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:56.138493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:56.145210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:56.145803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:56.146791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:56.148405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:56.149285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:56.150240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:56.197305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:56.198625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:56.211124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:56.212163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:56.212952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:56.214597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:56.215532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:56.216411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:56.308883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:56.321255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f39a88f1-c0a9-49f7-85cf-4b00b96ca9e9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1293 microversion: 2.1 time: 0.131196 Aug 31 12:22:56.322213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 265/555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:56 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1293 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:56.374954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:56.393096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e5832e00-d082-48c8-8afd-8b9cc06045d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.259043 Aug 31 12:22:56.394559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 291/556] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:57.348414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:57.349374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:57.359426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:57.360120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:57.360711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:57.361887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:57.362589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:57.363037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:57.426959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:57.428591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:57.435456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:57.436250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:57.436817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:57.437730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:57.438239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:57.440488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:57.821611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:57.837508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d88db9c3-c2fe-4948-846f-1b8a34535e94 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.494786 Aug 31 12:22:57.848311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:57.848858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 266/557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:57 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:57.864045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-95e0cd1f-6f69-4a02-a128-b8cb4f54c389 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.442786 Aug 31 12:22:57.864813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 292/558] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:22:58.614944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-93ac4301-f42f-46a3-bf6a-5423fd1f5f07 req-47e7d6f1-a37d-4e0c-aa14-13696c74b18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659e57d5-c27a-45e8-96b5-0a115cec46ee", "tag": "a7e90a3c-3dc3-407f-85aa-1369258bd64b"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:58.636171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-93ac4301-f42f-46a3-bf6a-5423fd1f5f07 req-47e7d6f1-a37d-4e0c-aa14-13696c74b18a service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:58.636849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-93ac4301-f42f-46a3-bf6a-5423fd1f5f07 req-47e7d6f1-a37d-4e0c-aa14-13696c74b18a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:58.637371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-93ac4301-f42f-46a3-bf6a-5423fd1f5f07 req-47e7d6f1-a37d-4e0c-aa14-13696c74b18a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:58.653342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-93ac4301-f42f-46a3-bf6a-5423fd1f5f07 req-47e7d6f1-a37d-4e0c-aa14-13696c74b18a service nova] Creating event network-changed:a7e90a3c-3dc3-407f-85aa-1369258bd64b for instance 659e57d5-c27a-45e8-96b5-0a115cec46ee on hv-cinder-85535 Aug 31 12:22:58.661868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-93ac4301-f42f-46a3-bf6a-5423fd1f5f07 req-47e7d6f1-a37d-4e0c-aa14-13696c74b18a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051817 Aug 31 12:22:58.662713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 267/559] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:22:58.868033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:58.883694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:58.905500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:58.905704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:58.914566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:58.916185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:58.917672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:58.917902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:58.918181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:58.918318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:58.919268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:58.919575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:58.919975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:58.920094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:58.920605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:58.920737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.272023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:59.285761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fec04588-b23d-4bd0-afe4-6c8ac80bfd99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.386997 Aug 31 12:22:59.286397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 268/560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:59.289412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:22:59.291732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1790011976"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:22:59.292260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:59.299203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.300013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.300442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.301177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.301757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.302763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.305692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff568cfb-e190-4b0a-a525-4c5f14035b2f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.442931 Aug 31 12:22:59.306744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 293/561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:22:58 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:22:59.318845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:59.319676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:59.326168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.326651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.327082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.327812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.328252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.329543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.369893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-826cd6c6-30e1-4fdc-8603-de3e5a2c6d06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments/aeaba963-7614-4090-8e58-3a50538fbaa8" status: 200 len: 194 microversion: 2.20 time: 0.056648 Aug 31 12:22:59.370427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 294/562] 10.222.0.27 () {60 vars in 1454 bytes} [Wed Aug 31 12:22:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments/aeaba963-7614-4090-8e58-3a50538fbaa8 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:22:59.461705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:59.462520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:59.469061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.469546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.469986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.471023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.471842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.472611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.474468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.network.security_group_api [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Removing security group c61c4dc4-4cbe-41f0-adcb-db31f45833e3 from port e019afe6-6742-49d8-a13f-9401fa9407a3 Aug 31 12:22:59.577681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lazy-loading 'services' on Instance uuid 6cd7c10d-e093-4252-a8a2-f47366d712be {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:22:59.669668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8c96b34-1904-4b00-9049-36ec1e6a3a53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments/aeaba963-7614-4090-8e58-3a50538fbaa8" status: 202 len: 0 microversion: 2.20 time: 0.212262 Aug 31 12:22:59.670300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 295/563] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Aug 31 12:22:59 2022] DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments/aeaba963-7614-4090-8e58-3a50538fbaa8 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 12:22:59.679853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:22:59.682852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:22:59.691554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.692065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.692499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.693213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:22:59.693666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:22:59.694074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:22:59.717623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:59.741616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0e0c52d-994b-4e55-81b3-afdeaef7c69a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066145 Aug 31 12:22:59.742177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 296/564] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:22:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:22:59.909808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-70da935b-7c0f-45e0-9af2-bf0e3d29932e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action" status: 202 len: 0 microversion: 2.1 time: 0.621851 Aug 31 12:22:59.910845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 269/565] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:22:59 2022] POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:23:00.309083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:00.310103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:00.317657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.318135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.318568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.319314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.319773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.320197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.331931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:00.332731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:00.339636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.340121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.340749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.341542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.341997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.342418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.615403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:00.627383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b0ede21-b684-46b1-bdea-06257359d177 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.300311 Aug 31 12:23:00.628323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 270/566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:00 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:00.648336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:00.657819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c62b13d0-7d75-472a-b36f-73c09f7b19bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.353899 Aug 31 12:23:00.658454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 297/567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:00.700909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-836b39d8-94a6-44dd-9a3d-1bb3f66af1e1 req-c5369560-dff7-48de-adf2-d2451cffa064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:00.715756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-836b39d8-94a6-44dd-9a3d-1bb3f66af1e1 req-c5369560-dff7-48de-adf2-d2451cffa064 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.715756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-836b39d8-94a6-44dd-9a3d-1bb3f66af1e1 req-c5369560-dff7-48de-adf2-d2451cffa064 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.715756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-836b39d8-94a6-44dd-9a3d-1bb3f66af1e1 req-c5369560-dff7-48de-adf2-d2451cffa064 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.732056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-836b39d8-94a6-44dd-9a3d-1bb3f66af1e1 req-c5369560-dff7-48de-adf2-d2451cffa064 service nova] Creating event network-changed:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:23:00.739419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-836b39d8-94a6-44dd-9a3d-1bb3f66af1e1 req-c5369560-dff7-48de-adf2-d2451cffa064 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042214 Aug 31 12:23:00.740057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 271/568] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:00.756724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:00.758860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:00.766096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.766577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.767398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.768413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:00.769150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:00.769597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:00.812709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cebb3d14-6d11-4bbc-b980-24c5b9075a88 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061030 Aug 31 12:23:00.813582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 298/569] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:01.371834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:01.372608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:01.379901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.380437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.380904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.381615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.382302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.382711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.494426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lazy-loading 'services' on Instance uuid ada8fc37-de0f-4cbd-9c71-0ed57100787a {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:23:01.598028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9087da2a-9ac0-4b3a-b7d7-db3eec3dc81c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments/487ee81b-f8c3-407a-94ff-cfb9399ce87d" status: 202 len: 0 microversion: 2.1 time: 0.231806 Aug 31 12:23:01.599081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 272/570] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:23:01 2022] DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments/487ee81b-f8c3-407a-94ff-cfb9399ce87d => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:23:01.615466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:01.618736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:01.629221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.630020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.630672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.631936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.632630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.633269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.665147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:01.667419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:01.678404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.678928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.679658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.681097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.682154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.683148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.684512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49a0fa1c-f1f4-4746-b574-430ae7cd689f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078004 Aug 31 12:23:01.685436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 299/571] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:01.694090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:01.695410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:01.706361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.707156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.707628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.708345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:01.708799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:01.709398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:01.957474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:01.965309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:01.967482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:01.980216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c6363de5-cbdb-45a3-a116-b16a60f1a03f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.323185 Aug 31 12:23:01.980548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 273/572] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:01 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:01.987030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:01.989399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:01.998553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-807c8a08-16b2-4a96-b099-aa3337b00354 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.311059 Aug 31 12:23:02.007445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:02.008236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:02.009251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:02.011339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:02.011571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 300/573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:02.011760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:02.011760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:02.075714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f86025ad-40f9-4b49-a7e0-41ae89d429c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093739 Aug 31 12:23:02.078573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 274/574] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:02.701217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:02.703559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:02.715853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:02.716489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:02.716949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:02.717757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:02.718205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:02.718619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:02.754612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-88361e50-51b7-4832-930e-64ccb36b7f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057323 Aug 31 12:23:02.759299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 301/575] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:02.762410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-31433ac0-ac9d-4807-ae98-a64a6360fec1 req-7b455140-9efb-48ed-8d7c-d25cf78e8777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:02.776383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-31433ac0-ac9d-4807-ae98-a64a6360fec1 req-7b455140-9efb-48ed-8d7c-d25cf78e8777 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:02.776863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-31433ac0-ac9d-4807-ae98-a64a6360fec1 req-7b455140-9efb-48ed-8d7c-d25cf78e8777 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:02.777275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-31433ac0-ac9d-4807-ae98-a64a6360fec1 req-7b455140-9efb-48ed-8d7c-d25cf78e8777 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:02.796361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-31433ac0-ac9d-4807-ae98-a64a6360fec1 req-7b455140-9efb-48ed-8d7c-d25cf78e8777 service nova] Creating event network-changed:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:23:02.802183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-31433ac0-ac9d-4807-ae98-a64a6360fec1 req-7b455140-9efb-48ed-8d7c-d25cf78e8777 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043923 Aug 31 12:23:02.802780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 275/576] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:03.019280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:03.019887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:03.026910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.027495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.027900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.028600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.029177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.029627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.034716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:03.035900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:03.043002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.043677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.044089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.044800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.045256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.046112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.632703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:03.636188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:03.642265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3058a798-f693-4cee-8658-9f87b50eecfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.612476 Aug 31 12:23:03.642858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 276/577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:03.646658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-654128d2-93c7-4590-988f-a54f18c9e43b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.631534 Aug 31 12:23:03.647599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:03.647938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 302/578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:03 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:03.651389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:03.661724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.662297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.662981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.663955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.664453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.665007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.704850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9751db05-2d04-4c53-9b4b-14c521a009b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060177 Aug 31 12:23:03.706061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 277/579] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:03.770054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:03.772313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:03.779819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.780304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.780762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.781469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:03.781901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:03.782334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:03.835438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdb595eb-fad6-416b-8b9a-bfec04f56325 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071584 Aug 31 12:23:03.836429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 303/580] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:04.668143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:04.669156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:04.670566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:04.671955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:04.681057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:04.681822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:04.682034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:04.682583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:04.682845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:04.683748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:04.683916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:04.684439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:04.684954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:04.685112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:04.685670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:04.686337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:04.957396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:04.984108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:04.994634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:04.995476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bd2c37e8-64d5-423f-acc2-ecb1de3a6555 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.333629 Aug 31 12:23:04.996011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 278/581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:05.003162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:05.006372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:05.016246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-69cc6518-3943-4ca1-bfa7-3e344669f15b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.351651 Aug 31 12:23:05.016600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:05.017366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:05.018085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:05.019490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:05.020159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:05.020890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:05.025233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 304/582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:04 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:05.031196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:05.033505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:05.041641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:05.042416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:05.043095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:05.044172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:05.044837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:05.045465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:05.077023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a80fa323-6578-49b5-a9de-bf887bcac36b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079474 Aug 31 12:23:05.078042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 279/583] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:05.089240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bfa38d9e-9b8f-4dcf-b830-c8a05d89f05d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062538 Aug 31 12:23:05.090308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 305/584] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:06.024845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:06.025789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:06.029543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=12 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:06.037185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.038074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.038786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.039703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.040458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.041557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.054381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:06.056048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:06.066422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.067061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.067763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.068531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.068985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.069442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.290233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:06.294150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:06.306277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2badc270-e278-4001-8d60-598fc9088f5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.286885 Aug 31 12:23:06.307015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b12fb804-5f52-4c3b-9bd2-09719fd5c651 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.256516 Aug 31 12:23:06.323293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 280/585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:06.323542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 306/586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:06 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:06.323633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:06.323713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:06.323790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:06.323883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:06.329730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.329920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.330500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.330639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.332155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.332308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.332425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.332507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:06.333158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.333457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:06.333883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.334232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:06.375907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f70a3708-77a3-4908-82b4-95ecc57623db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066355 Aug 31 12:23:06.377468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-01f6cdd6-4590-4f90-bf44-952ea3f739ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068399 Aug 31 12:23:06.378042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 281/587] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:06.387295 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 307/588] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:07.330205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:07.330911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:07.337688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.338169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.338603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.339316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.339772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.340201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.346237 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:07.347090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:07.354865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.355484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.356090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.356821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.357416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.357720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.581495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:07.588559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:07.590408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-93ea86bb-5d4a-4dc9-89e6-3052694d70e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.264296 Aug 31 12:23:07.591004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 282/589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:07.597121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:07.598500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-55507998-11a6-4c9b-a266-4ba07c2cf6be tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.257398 Aug 31 12:23:07.599194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 308/590] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:07 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:07.599355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:07.604721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:07.605900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.606448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.606891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.607714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.608347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.608769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:07.608891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.611912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:07.617958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.618587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.619120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.619966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:07.620493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:07.620984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:07.647495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8403c493-3ac6-42d3-a17b-cfdd70473788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055270 Aug 31 12:23:07.648065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 283/591] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:07.658659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-793a11be-4677-4f15-bf65-b6f5035edbb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057947 Aug 31 12:23:07.659401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 309/592] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:08.236274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-35d5011d-e890-4645-9be9-ecc0e1ee2cbf req-82edd292-95b2-4a65-ae99-50acf3229581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659e57d5-c27a-45e8-96b5-0a115cec46ee", "name": "network-vif-plugged", "status": "completed", "tag": "a7e90a3c-3dc3-407f-85aa-1369258bd64b"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:08.246852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-35d5011d-e890-4645-9be9-ecc0e1ee2cbf req-82edd292-95b2-4a65-ae99-50acf3229581 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.247401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-35d5011d-e890-4645-9be9-ecc0e1ee2cbf req-82edd292-95b2-4a65-ae99-50acf3229581 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.247835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-35d5011d-e890-4645-9be9-ecc0e1ee2cbf req-82edd292-95b2-4a65-ae99-50acf3229581 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.261597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-35d5011d-e890-4645-9be9-ecc0e1ee2cbf req-82edd292-95b2-4a65-ae99-50acf3229581 service nova] Creating event network-vif-plugged:a7e90a3c-3dc3-407f-85aa-1369258bd64b for instance 659e57d5-c27a-45e8-96b5-0a115cec46ee on hv-cinder-85535 Aug 31 12:23:08.267259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-35d5011d-e890-4645-9be9-ecc0e1ee2cbf req-82edd292-95b2-4a65-ae99-50acf3229581 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Aug 31 12:23:08.267976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 284/593] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:08.614391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:08.615032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:08.624041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.624556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.624952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.625655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.626359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.627085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.628532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:08.629344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:08.640330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.640932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.641566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.642710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.643415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.644095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.857891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:08.864761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:08.869912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-008c147a-914b-47bb-b7f2-81697e17bcfc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.260361 Aug 31 12:23:08.870639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 310/594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:08.876612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:08.879685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83be2627-54da-4a0e-b2ea-bd6026541b9f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.256202 Aug 31 12:23:08.879905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:08.880614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 285/595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:08 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:08.887196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.887703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.888145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.888825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.889271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.889694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.889880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:08.894843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:08.903260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.903757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.904207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.904928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:08.905406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:08.905821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:08.943082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbea2b25-e78f-4bb7-a329-94dd77c7c809 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070471 Aug 31 12:23:08.943969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 311/596] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:08.952611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bcdc519d-2934-4f29-88a3-7e540f049bec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070831 Aug 31 12:23:08.953169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 286/597] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:09.894949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:09.895596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:09.904640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:09.905433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:09.906030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:09.906902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:09.907485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:09.908031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:09.913629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:09.914572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:09.924636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:09.925254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:09.925684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:09.926385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:09.926859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:09.927372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:10.122247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:10.127008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:10.132841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66ae0402-8097-4686-947a-3321e72be1d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.242635 Aug 31 12:23:10.133568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 312/598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:10.138475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:10.140841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:10.143560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-039f212c-4df6-4d9b-a031-5af0a2793d88 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.235754 Aug 31 12:23:10.145628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 287/599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:09 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:10.147962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:10.148650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:10.149055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:10.149767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:10.149893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:10.150210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:10.155153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:10.155366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:10.155775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:10.162245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:10.162718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:10.163185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:10.163930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:10.164439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:10.164874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:10.187391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-97372665-dfa4-4b5b-92e8-993b001b51c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052651 Aug 31 12:23:10.188369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 313/600] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:10.200533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f74e84d1-b71d-40fc-8d28-9b1f46c473e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055281 Aug 31 12:23:10.201093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 288/601] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:11.154491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:11.155117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:11.162333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.162833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.163265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.163969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.164435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.164827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.168014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:11.168579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:11.176722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.177210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.177644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.178321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.178770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.179187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.384936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:11.388618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:11.395774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34fe8540-f9ca-4c53-9ae8-f6f8de97abf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.245363 Aug 31 12:23:11.396359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 314/602] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:11.397435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7306e8f3-18e5-45f4-b5a0-3c61cbddf56b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.234230 Aug 31 12:23:11.410995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 289/603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:11 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:11.411195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:11.411195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:11.411397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:11.411397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:11.411538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.411538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.411683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.412385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.412832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.413244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.417465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.417998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.418435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.419170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:11.419659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:11.420110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:11.448397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-880b6320-16cf-49b6-90cb-f2963a2fb631 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050925 Aug 31 12:23:11.449177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 315/604] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:11.453454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f94836b-a1e2-4e3d-9c5c-85cac46245b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054198 Aug 31 12:23:11.454110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 290/605] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:12.420236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:12.421266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:12.421634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:12.421758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:12.428287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.428784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.429216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.429592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.429915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.430072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.430363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.430506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.430781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.431250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.431770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.432194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.730316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:12.736816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:12.739128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:12.740602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7460e6f0-9429-4c8e-8cfa-a05f752a9979 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.324310 Aug 31 12:23:12.740602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 316/606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:12.745564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:12.748082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:12.749302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0de38a14-f7ba-4371-9441-70f0eea8a277 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.333685 Aug 31 12:23:12.750167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 291/607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:12 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:12.754670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.755189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.755603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:12.755734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.756403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.756845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.757257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.758151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:12.765153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.765796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.766301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.767225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:12.767809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:12.768238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:12.789393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-642d9c7f-e3fd-4492-961a-1e157e028803 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047804 Aug 31 12:23:12.790034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 317/608] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:12.799636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-170d9b90-07e8-4759-bcb2-06414b9de35e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048435 Aug 31 12:23:12.800189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 292/609] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:13.771003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:13.771666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:13.774251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:13.774909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:13.779139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:13.779674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:13.780292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:13.781042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:13.781548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:13.781744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:13.781927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:13.782295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:13.783031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:13.783832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:13.784289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:13.784887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:13.986166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:13.990655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:13.994168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73a9c02d-6193-4f23-8d0e-0edc79eed1bb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.227247 Aug 31 12:23:13.994745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 318/610] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:13 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:13.999427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:13.999609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1a2e6c31-b0f1-4ac6-9cba-45a6bd638507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.229028 Aug 31 12:23:14.000212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 293/611] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:14.002243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:14.007811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:14.008961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:14.009437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:14.009891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:14.010714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:14.010832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:14.011305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:14.011824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:14.018940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:14.019466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:14.019980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:14.020686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:14.021136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:14.021562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:14.044481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e1b7d95d-5122-4aab-9bff-506647b03090 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048363 Aug 31 12:23:14.045449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 319/612] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:14.060025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bdb6e5cf-c196-461d-90db-2d4b9bc4d5e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057272 Aug 31 12:23:14.060599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 294/613] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:15.016206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:15.016824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:15.023998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.024481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.024626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:15.025103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.025209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:15.025587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.026065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.026445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.031949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.032621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.033076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.033761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.034207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.034624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.266957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:15.272349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:15.275822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb471d44-8f5c-4f84-8f97-804c706a0cec tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.263522 Aug 31 12:23:15.276415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 320/614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:15 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:15.281505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:15.284109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:15.286014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-298c54e4-15d2-404c-b4f8-2660c2e02de1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.265381 Aug 31 12:23:15.287117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 295/615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:15.291741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.292338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.292516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:15.292860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.293843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.294592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.294707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:15.295136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.304294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.304787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.305256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.305965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:15.306448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:15.306923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:15.332446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f55e9597-d0bb-4cdf-bccd-86960c6182d8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054917 Aug 31 12:23:15.333028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 321/616] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:15.339842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28b0ea8e-b4f9-4c66-aac2-6e1755392b0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051923 Aug 31 12:23:15.340461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 296/617] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:16.310404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:16.311023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:16.311993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:16.312649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:16.318279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.318764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.319274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.319661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.319999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.320155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.320546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.320727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.320958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.321433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.321888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.322310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.536826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:16.540613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:16.552804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-946b6988-c9b2-4f78-8836-d2a111b60e02 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.244630 Aug 31 12:23:16.553515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f3af5607-6210-4221-a1c7-6598b5d129eb tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.246788 Aug 31 12:23:16.553802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 297/618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:16.554454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 322/619] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:16 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:16.561945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:16.563382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:16.566277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:16.568480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:16.575968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.576709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.577449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.578709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.579528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.580243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.582199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.582958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.583672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.584801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:16.585565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:16.586253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:16.616883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d8e6d5c-e25b-4e3f-8aaf-4c5d12ab3b11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061909 Aug 31 12:23:16.617478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 298/620] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:16.617817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ed38f105-91b7-475b-9678-18ee40099801 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060685 Aug 31 12:23:16.618664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 323/621] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:17.576613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:17.577496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:17.577862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:17.577972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:17.584507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.584991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.585118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.585416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.585524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.585922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.586108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.586557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.586662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.586974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.587094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.587476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.804511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:17.809946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:17.814699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2221bf2c-64e7-4da2-98a6-0c95753b8b0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.241333 Aug 31 12:23:17.815463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 299/622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:17.820095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:17.820922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-977c9fe2-d646-433a-8950-17c1831776a2 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.248219 Aug 31 12:23:17.821852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 324/623] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:17 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:17.823336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:17.826890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:17.829375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:17.830824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.831573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.832356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.833319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.833981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.835323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.835436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.835899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.836330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.837021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:17.837467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:17.837889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:17.870001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-177fb082-e4a4-45ac-84b4-7dbfa80880f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054029 Aug 31 12:23:17.870572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 300/624] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:17.872268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c9d30a67-94ff-4e43-8f6d-ade6a9681d1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049275 Aug 31 12:23:17.872841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 325/625] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:18.842757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:18.843421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:18.849924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:18.850634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:18.850919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:18.851714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:18.852202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:18.852902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:18.853348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:18.853763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:18.857144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:18.857626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:18.858051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:18.858773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:18.859218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:18.859651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:19.060374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:19.064973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:19.069122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d90f3bbb-c999-483f-856d-34fb0d66c759 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.222994 Aug 31 12:23:19.069701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 326/626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:18 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:19.073631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-abb108e2-5c49-4e30-b641-49ba2a7573b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.235250 Aug 31 12:23:19.074396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 301/627] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:19.080527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:19.082694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:19.083867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:19.086666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:19.089442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:19.089936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:19.090365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:19.091064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:19.091554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:19.092014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:19.094005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:19.095065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:19.095655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:19.096341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:19.096822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:19.097248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:19.125031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-151adff0-228e-446c-a66c-261939883b48 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Aug 31 12:23:19.125830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 302/628] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:19.130001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0efd02a1-6444-4f7a-8ad9-163d6a60c888 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059247 Aug 31 12:23:19.130587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 327/629] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:20.091481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:20.092107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:20.097331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:20.097880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:20.099608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.100105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.100546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.101270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.101756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.102177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.104994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.105468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.105915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.106730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.107122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.107577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.307436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:20.312508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:20.316436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4afa625-95c3-494f-966f-80b845bfc9d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.223030 Aug 31 12:23:20.317021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 328/630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:20.321761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:20.323896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:20.326536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7de6aaad-a6ad-4e61-9409-bc4646658eb0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.238844 Aug 31 12:23:20.326965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 303/631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:20 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:20.330517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.331359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.332060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.332268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:20.332940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.333390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.333799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.334811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:20.342251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.342612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.343051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.343804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:20.344317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:20.344728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:20.360677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:20.368475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82093f0e-1aa9-4af1-a971-9b9cbca9dbff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050345 Aug 31 12:23:20.369429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 329/632] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:20.380089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02c14b20-8aa4-43b6-997e-eb137f1e64a5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051968 Aug 31 12:23:20.381047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 304/633] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:21.340618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:21.341364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:21.348764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:21.349547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:21.350185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.350671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.351680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.352559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.353145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.353706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.357280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.358080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.358555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.360883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.360883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.361131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.588909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:21.592033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:21.598967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-da8cf7cd-e5b9-45e5-af74-c567c0dc18c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.263879 Aug 31 12:23:21.599641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 330/634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:21.600785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9e42fc2b-c237-4796-b719-31ae290bf396 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.256885 Aug 31 12:23:21.603659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 305/635] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:21 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:21.604547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:21.606779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:21.609360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:21.611963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:21.614142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.614640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.615160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.615812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.616260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.616674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.619495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.619991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.620436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.621141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:21.621598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:21.622030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:21.651170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9208e10-25da-42e7-8965-cb2d74749ddf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Aug 31 12:23:21.651828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 331/636] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:21.657607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5a7f1acb-3582-4f13-a595-6814d97e6329 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054677 Aug 31 12:23:21.658010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 306/637] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:22.622837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:22.623677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:22.626295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:22.627290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:22.632342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:22.632695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:22.633307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:22.634091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:22.634609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:22.635192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:22.638372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:22.639119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:22.639822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:22.640903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:22.641654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:22.642729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:22.948765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:22.961324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-68417fb2-b4bd-426a-9c14-6a47336e5d0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.342977 Aug 31 12:23:22.962175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 332/638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:22.969580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:22.969918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:22.972921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:22.982165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:22.982867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:22.983515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:22.984553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:22.985279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:22.986025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:22.990592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-96d3935e-4ba3-47aa-b9bf-feda12190cd7 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.370373 Aug 31 12:23:22.991954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 307/639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:22 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:23.009867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:23.012425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:23.023206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:23.023985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:23.024671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:23.025779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:23.026485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:23.027128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:23.027746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcc2d801-3a5f-478b-9715-d01773a3af17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064244 Aug 31 12:23:23.028597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 333/640] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:23.046631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:23.072056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8ce67255-a284-4c80-92da-6a178d530108 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078540 Aug 31 12:23:23.072774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 308/641] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:24.003131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:24.004197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:24.015997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.016628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.017069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.017811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.018270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.018701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.026369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:24.027491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:24.035835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.036481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.037044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.038261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.039054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.040375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.321367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:24.330081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:24.335937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d0660eec-b329-4174-bd6d-dc9c5ecf9bb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.339938 Aug 31 12:23:24.336972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 334/642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:24.339522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-32f02c51-7a2b-47f2-b625-4186851950f0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.318049 Aug 31 12:23:24.340854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 309/643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:24 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:24.347630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:24.350746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:24.350947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:24.354895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:24.361873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.362637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.363556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.364859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.365521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.366128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.366967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.367792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.368517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.369896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:24.370540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:24.371171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:24.405650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-532e8df9-7ab1-4356-84bd-c20ef781fa02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066992 Aug 31 12:23:24.406823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 335/644] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:24.411785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a36d52ac-5e5e-42f9-bbaf-e7e4b93cf65d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069001 Aug 31 12:23:24.412471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 310/645] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:25.371259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.371960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:25.379036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.379568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.380039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.380730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.381244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.381615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.395010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.396584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:25.398601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=96 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:25.405957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.406665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.407164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.408011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.408588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.409107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.691949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:25.701916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4d15204-e045-49f2-b8bd-5a685329a330 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.334686 Aug 31 12:23:25.702523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 336/646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:25.707645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.709900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:25.712865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:25.716922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.717508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.718227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.719714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.720333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.720880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.728805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d85ff716-2310-442e-afe0-91cd624582db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.346902 Aug 31 12:23:25.729804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 311/647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:25.738523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:25.743700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:25.752059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.752725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.753524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.754733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:25.755493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:25.756150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:25.763000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c7ed1df5-0a50-45b0-828a-e0267bfd5b77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059027 Aug 31 12:23:25.763763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 337/648] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:25.800069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab23c12d-b6d3-49a0-8d70-70f885a5d158 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068482 Aug 31 12:23:25.800756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 312/649] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:26.754251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:26.754907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:26.762350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:26.762847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:26.763309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:26.764018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:26.764464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:26.765351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:26.765470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:26.766053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:26.788059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:26.788550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:26.788984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:26.789701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:26.790515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:26.791075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:27.042781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:27.055016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e1526c0-5e73-42dd-a19c-d3a6cac991ff tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.304470 Aug 31 12:23:27.056409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 338/650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:27.062787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:27.064685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:27.067563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:27.074365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d4ce5b0-e35c-434f-a754-9b5c765df449 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.312844 Aug 31 12:23:27.075432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:27.075743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 313/651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:26 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:27.076058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:27.076709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:27.077754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:27.078383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:27.078980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:27.082865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:27.085119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:27.094640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:27.095124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:27.095767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:27.096660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:27.097186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:27.097606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:27.122585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-48e7ec2e-79f0-42e9-a9b2-c9160dab0de1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064339 Aug 31 12:23:27.123479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 339/652] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:27.142506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9eccdb70-674f-4d22-87c0-1a22db7e8f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064992 Aug 31 12:23:27.143508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 314/653] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:28.081180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.082203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:28.092134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.092471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.093153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.095346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.096087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.096696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.108087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.109273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:28.119179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.120110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.120852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.122151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.122949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.123711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.349928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:28.363585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30d846cf-cb42-4c32-bc43-97cbc42d64d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.288379 Aug 31 12:23:28.364509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 340/654] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:28.368696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:28.374393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.388341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:28.389358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4bff188b-6729-48cc-babf-bb391932ec19 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.288291 Aug 31 12:23:28.390726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 315/655] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:28.396919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:28.396919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:28.403656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.403656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.403656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.404257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.404861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.405595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.405784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.406223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.406966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.407815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:28.408309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:28.408947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:28.446022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4db8fb12-625f-47c6-ae12-065afcf7fc30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054796 Aug 31 12:23:28.447000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 316/656] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:28.449704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4588a966-b545-46a0-8d18-5048a9dbd307 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083496 Aug 31 12:23:28.450739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 341/657] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:29.396947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:29.397957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:29.408975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.409718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.410432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.411663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.412425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.413132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.416384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:29.417404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:29.427269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.428055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.428780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.429930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.430674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.431750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.668465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:29.681372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d46cdfe-3de2-4188-a84a-ee3ea55dc630 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.270063 Aug 31 12:23:29.682424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 342/658] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:29 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:29.689824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:29.693066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:29.701921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.702583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.703610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.704647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.705290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.705860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.758584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c2a562d3-9c14-4c9b-ba64-277ce6e9b9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074478 Aug 31 12:23:29.759346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 343/659] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:29.767271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:29.769527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:29.776230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.776699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.777655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.777897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:29.778264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:29.778885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:29.820151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-77f60e5e-7022-43bb-9bba-642af4f1c31f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059232 Aug 31 12:23:29.821354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 344/660] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:29.913469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:29.924202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c096a389-cbba-4650-8065-a372919a58ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.534184 Aug 31 12:23:29.924806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 317/661] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:30.708404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:30.709238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:30.716533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.717023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.717484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.718191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.718767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.719284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.776447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:30.779349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:30.787005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.787540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.787972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.788714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.789161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.789570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.842027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ace70e8f-778f-4c80-a7ac-bae0edeb1bb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069543 Aug 31 12:23:30.843082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 318/662] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:30.853321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:30.857685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:30.869539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.870359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.871219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.872510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.873323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.874915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.934413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db78077f-1bdd-40ab-878b-aecb50b325ac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088678 Aug 31 12:23:30.934703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:30.935484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 319/663] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:30.949308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb94f3d7-f24e-4e00-9c83-0d9ca956da17 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.244843 Aug 31 12:23:30.960424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 345/664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:30 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:30.960709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:30.960709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:30.967091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.967675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.968148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:30.969274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:30.969875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:30.970389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:31.162284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:31.173922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-efad0373-939c-4179-b97b-6441ac7d81fa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.221393 Aug 31 12:23:31.174702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 320/665] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:31.859496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:31.862609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:31.870625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:31.871119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:31.871588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:31.872321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:31.872775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:31.873199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:31.890644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:31.911422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d24e509-67e0-428d-8df4-624ba20518db tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058078 Aug 31 12:23:31.911718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 346/666] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:31.954801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:31.957135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:31.964917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:31.965467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:31.965948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:31.966792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:31.967691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:31.968429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:31.977667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:31.978668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:31.988996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:31.989791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:31.990503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:31.991795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:31.992576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:31.993392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:32.024843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da7ff9f2-117c-4c2e-b9c1-adc0873aad36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074567 Aug 31 12:23:32.025735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 321/667] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:32.196424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:32.210467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1636412b-df16-4d47-96c2-4e2c036587b9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.238483 Aug 31 12:23:32.213118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 347/668] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:31 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:32.214237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:32.215385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:32.224439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:32.225009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:32.225504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:32.226391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:32.226918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:32.227448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:32.417550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:32.427415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7d47393-d0b3-4ebd-a328-4f4eb814ea46 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.219945 Aug 31 12:23:32.428014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 322/669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:32.929206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:32.932139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:32.940533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:32.941025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:32.941447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:32.942180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:32.942669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:32.943142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:32.983390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9714810d-cc26-47a5-bfbf-c09d358f1ad0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058911 Aug 31 12:23:32.984182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 348/670] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:33.042552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:33.045874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:33.054445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:33.055185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:33.055833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:33.056835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:33.057382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:33.057848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:33.102847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b5ba357c-7416-471f-af3e-e8a048989a16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064721 Aug 31 12:23:33.103852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 323/671] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:23:33.248626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:33.249438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:33.258184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:33.258674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:33.259102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:33.259908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:33.260366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:33.260789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:33.450787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:33.451705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:33.458482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:33.458876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:33.459344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:33.460090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:33.460550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:33.460972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:33.579224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:33.593197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0547e362-952b-405c-beb0-244d0584df89 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.350950 Aug 31 12:23:33.594319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 349/672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:33 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:33.665838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:33.675601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fc7a86d3-7539-4b37-a66a-79087aee50a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.229367 Aug 31 12:23:33.676212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 324/673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:33.997966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:34.000671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:34.008313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.008821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.010106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.010415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.010910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.011376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.051094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf5137be-a391-438c-a9dc-c3ce463d25dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057407 Aug 31 12:23:34.051735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 350/674] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:34.122111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:34.124774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:34.134403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.135053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.135769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.136812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.137376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.137893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.142885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:34.181168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a4a3e9bb-a4dd-4b46-bda7-66b7a65629fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063466 Aug 31 12:23:34.181955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 325/675] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:34.626840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:34.627945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:34.639364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.640167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.640167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.642223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.642989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.643737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.716867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:34.718166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:34.729473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.730311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.731059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.739950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:34.739950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:34.739950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:34.911456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:34.922526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ee1ca0f-82b3-4937-9be7-289f90c89a80 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.302959 Aug 31 12:23:34.923152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 351/676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:34 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:34.976188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:34.992038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5e46a0f8-0539-45c3-82cd-d6314af4223f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.282040 Aug 31 12:23:34.993073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 326/677] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:35.065263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:35.067599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:35.075277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:35.075785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:35.076220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:35.077126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:35.077443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:35.077900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:35.117898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6de31627-51c1-49d3-a1da-300d7ac9ef73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057284 Aug 31 12:23:35.118534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 352/678] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:35.195088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:35.197871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:35.205343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:35.205841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:35.206311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:35.207225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:35.207581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:35.207989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:35.256212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-acf14af0-3032-442e-a9c2-275b732d0e06 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065482 Aug 31 12:23:35.257108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 327/679] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:35.950761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:35.951452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:35.959176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:35.959776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:35.960302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:35.961115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:35.961694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:35.962356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.029473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:36.030283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:36.039205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:36.040298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:36.041003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.041853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:36.042399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:36.043135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.243787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:36.255014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9904862f-9f5c-48a4-ad06-e4f59a6c186a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.308175 Aug 31 12:23:36.256268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 353/680] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:35 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:36.264195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:36.269415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:36.281881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:36.282744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:36.283508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.284345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:36.284856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:36.285410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.328501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3ddf5618-5d8f-4b3d-a8ff-62a3079d0dd4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070325 Aug 31 12:23:36.329987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 354/681] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:36.336361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:36.351863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a5bf126-a5e8-4d63-90bd-66988ebe459b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.328269 Aug 31 12:23:36.353099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 328/682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:36.487436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:36.491456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:36.501894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:36.502694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:36.503443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.504643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:36.505398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:36.506129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:36.554094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-291844b0-3576-4160-8780-3ee21b56cb59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.221949 Aug 31 12:23:36.554778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 355/683] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:37.294587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:37.295341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:37.303284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.303781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.304217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.304928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.305379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.305799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.349180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:37.351633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:37.358778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.360631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.361192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.362315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.362787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.363215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.412583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e3d692a-9e40-49a4-93b5-74d7f477273a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069239 Aug 31 12:23:37.413361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 356/684] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:37.419718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:37.420759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:37.430987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.431742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.432404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.433083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.433554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.434035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.517537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:37.533104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-90b034c1-79d5-4b97-b29f-0bd54f779925 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.245930 Aug 31 12:23:37.533931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 329/685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:37 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:37.573454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:37.577081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:37.588055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.588867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.589590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.590830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:37.591666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:37.592385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:37.648855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3356d682-7882-4783-ad34-8b5c99556f66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082554 Aug 31 12:23:37.649918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 330/686] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:37.653912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:37.665020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-97ecd30c-6cfb-4fd7-88be-788ac18766ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.249852 Aug 31 12:23:37.666165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 357/687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:38.436017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:38.439378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:38.447021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.447547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.447984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.448708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.449166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.449598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.489315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c2631f9-c46f-4287-bf09-765fccf89e0e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058307 Aug 31 12:23:38.489974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 331/688] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:38.569392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:38.570338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:38.573405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=98 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:38.581671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.582312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.582796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.583750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.584300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.584869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.665494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:38.668026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:38.675487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.676006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.676442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.677152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.677586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.680061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.722176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5f696ed5-1b48-4655-9c3e-a211f7a20a80 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060975 Aug 31 12:23:38.723476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 332/689] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:23:38.731816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:38.732825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:38.743361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.744192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.744907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.746100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:38.746849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:38.747597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:38.777499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:38.787180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8b948eec-3dac-4050-b47b-57ddb888331b tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.221969 Aug 31 12:23:38.787820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 358/690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:38 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:38.930167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:38.940894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9725f2d9-9361-434b-8e4f-89f0f534d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.215608 Aug 31 12:23:38.941397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 333/691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:39.503563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:39.507151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:39.517339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.518297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.519196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.520297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.520826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.521297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.563019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a5bcbaf1-dacf-4ecd-93f8-faaf2ef663c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064471 Aug 31 12:23:39.563639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 359/692] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:39.742867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:39.746824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:39.759376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.760156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.760948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.762248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.763056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.763837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.810510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:39.811122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:39.818666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.819416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.819947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.820745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.821255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.821770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.823890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bb777c4b-eb64-47f6-a1be-39069df49601 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088498 Aug 31 12:23:39.824935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 334/693] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:39.979181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:39.980641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:39.993379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.994767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.995570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:39.996826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:39.997875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:39.998852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:40.033176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:40.055211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e6fdc9d9-fbc9-4976-b75c-1db96757c304 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.248546 Aug 31 12:23:40.056123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 360/694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:39 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:40.233606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:40.243616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cffa5eae-2d60-41e8-93ac-acbda625c603 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.272916 Aug 31 12:23:40.244417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 335/695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:40.582287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:40.586484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:40.598364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:40.599220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:40.600044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:40.601324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:40.602139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:40.602890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:40.662900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa101f22-26e8-468a-a774-8780c6d543a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088123 Aug 31 12:23:40.663940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 361/696] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:40.842802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:40.846570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:40.858734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:40.859752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:40.860683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:40.861936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:40.862746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:40.863514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:40.925593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5421bdff-882b-4e71-b0e3-325c216c6caa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090234 Aug 31 12:23:40.926607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 336/697] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:41.082002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:41.083188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:41.096346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.097045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.097835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.099128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.100001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.100753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.275499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:41.276609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:41.288368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.290150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.291263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.292955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.294012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.295010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.312685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:41.327354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-55b97a3f-5fcb-42c6-946a-282f7853c5db tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.252316 Aug 31 12:23:41.328838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 362/698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:41 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:41.508066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:41.524616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-41ce9b78-6cd8-495d-bf36-c28f1dede579 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.257388 Aug 31 12:23:41.525600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 337/699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:41.681506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:41.683946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:41.692271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.692830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.693471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.694363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.695059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.695692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.699447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:41.734892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f9721791-61d6-4521-a3fa-feb7c931af33 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057626 Aug 31 12:23:41.735525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 363/700] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:41.948114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:41.951513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:41.963649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.968700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.969496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:41.970814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:41.971655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:41.972378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.043465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-224597f0-20e7-4017-90c7-eb72536b2bc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102527 Aug 31 12:23:42.044507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 338/701] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:42.365522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:42.366429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:42.376156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:42.376838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:42.377374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.378125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:42.378582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:42.379007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.550738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:42.551813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:42.555424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:42.563391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:42.564192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:42.564909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.566126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:42.566889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:42.567622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.568608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd91ecc7-3352-488d-a693-e2c6f6286a40 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.210771 Aug 31 12:23:42.569563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 364/702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:42 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:42.735936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:42.749837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-860d8b94-e3db-48c7-8aba-f74f6790d754 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.205050 Aug 31 12:23:42.750529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 339/703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:42.754423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:42.757566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:42.766768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:42.767550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:42.768091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.769031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:42.769657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:42.770225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:42.808402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6ca171bd-5d24-443f-8e46-5a43880e9c7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060648 Aug 31 12:23:42.809072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 365/704] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:43.059921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:43.062513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:43.070652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.071344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.071957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.073030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.073633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.074147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.111518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-82ace14e-c9eb-4c17-8627-2ef4712bff2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055980 Aug 31 12:23:43.112112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 340/705] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:43.596403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:43.597490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:43.609432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.610311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.611055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.612336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.613127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.613819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.778882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:43.779964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:43.786648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:43.789425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.790390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.791129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.792341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.792897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.793457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.803206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49ad20c8-ea58-4061-b4b4-f269d45a301c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.213669 Aug 31 12:23:43.804610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 366/706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:43 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:43.830011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:43.833964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:43.847468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.848356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.849204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.850467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:43.851281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:43.852249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:43.911869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-962a1901-6b99-4e37-b224-a3e354e80fb4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090890 Aug 31 12:23:43.913397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 367/707] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:44.022907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:44.025739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:44.034822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-59b72644-db70-4dbf-beda-d1a55eb0f2c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.263368 Aug 31 12:23:44.035445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 341/708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:44.130545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:44.134344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:44.145645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:44.146448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:44.147166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:44.148482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:44.149252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:44.150030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:44.224532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0888dedf-ed5f-45a6-a026-ca6f6d9698d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101357 Aug 31 12:23:44.225750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 368/709] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:44.842368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:44.843576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:44.856061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:44.857149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:44.858393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:44.859807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:44.860658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:44.861451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:44.935273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:44.940223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:44.954475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:44.955545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:44.956639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:44.958393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:44.959447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:44.960339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:45.026490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4e84d83e-d699-4356-b240-2a6b865b6067 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099538 Aug 31 12:23:45.028062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 369/710] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:45.077696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:45.078917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:45.093275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:45.094038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:45.094840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:45.097461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:45.098313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:45.098986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:45.123392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:45.147964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7f0a785-3ff1-4e6d-99df-e0f7dc82696d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.312924 Aug 31 12:23:45.149501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 342/711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:44 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:45.244654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:45.247352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:45.258062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:45.258879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:45.260255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:45.261065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:45.261880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:45.262638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:45.323775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55d56327-3a93-43af-9b67-819c0e382b2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085238 Aug 31 12:23:45.324713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 343/712] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:23:45.338252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:45.352351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ce417fa-5569-4f8b-bf44-78d5d6c0bb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.285628 Aug 31 12:23:45.353093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 370/713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:46.046875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:46.050755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:46.063057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.063663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.064428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.065738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.066654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.067436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.127120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-484c5b49-e4f1-4427-b9b0-749d78b5ef2b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087716 Aug 31 12:23:46.128108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 344/714] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:46.178982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:46.180061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:46.191608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.192391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.193086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.194276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.195041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.195768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.345003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:46.347995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:46.356425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.357127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.357882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.358900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.359825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.360397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.404457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f1d5ecc-f86a-444f-b66c-bfae997b17b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066536 Aug 31 12:23:46.409229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 345/715] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:46.410271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:46.411073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:46.411669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:46.418186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.418761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.419211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.420210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:46.420447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:46.420981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:46.423264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c8441b1-5f92-499e-b0e2-a36723708bc0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.252016 Aug 31 12:23:46.424032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 371/716] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:46 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:46.626917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:46.637356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f3024cf-c285-429d-a205-b4bbe5de6bfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.231273 Aug 31 12:23:46.637961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 346/717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:47.143752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:47.146141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:47.154777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.155571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.156327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.157667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.158829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.159861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.210316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4d100ef4-f125-49f0-8cf3-7510ff5e7df6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071553 Aug 31 12:23:47.211517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 372/718] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:47.422676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:47.426405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:47.438642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.439528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.440310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.441569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.442343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.443044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.449999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:47.451122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:47.462342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.463194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.464040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.465319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.466155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.466897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.502108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2fbec64-4c02-49b6-bbcf-a25fc0a175d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086810 Aug 31 12:23:47.503063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 347/719] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:47.677547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:47.678597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:47.682316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:47.688202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.688879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.689485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.690320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:47.690845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:47.691370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:47.697633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a08271a5-70eb-4e0f-812d-23738afb0c79 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.254391 Aug 31 12:23:47.698703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 373/720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:47 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:47.898731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:47.914778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c96d9e84-40c8-42a0-b481-19d9bd8b58e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.244106 Aug 31 12:23:47.916085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 348/721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:48.229223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:48.233232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:48.245336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.246203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.246970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.248328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.249165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.249924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.316708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-43c94dcb-0562-42d2-95c1-42aa77c57a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094957 Aug 31 12:23:48.317772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 374/722] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:48.519661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:48.522042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:48.529712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.530345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.530932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.532329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.533188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.533945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.581704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-261535a9-4567-4775-9341-c4da4b6a8702 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066715 Aug 31 12:23:48.582692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 349/723] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:48.735657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:48.736803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:48.747977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.749262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.749614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.751030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.751900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.752609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.947907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:48.955955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:48.956836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:48.958228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d96db05-3c2a-4343-a648-6b1db30fbf73 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.228847 Aug 31 12:23:48.959549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 375/724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:48 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:48.970295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.971470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.972215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:48.973384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:48.974160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:48.974885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:49.165070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:49.181705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5ca320c5-54e4-4f24-90c2-0850b831bc64 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.234814 Aug 31 12:23:49.182914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 350/725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:49.333872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:49.337142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:49.349072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:49.349804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:49.350255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:49.351040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:49.351548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:49.351980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:49.393869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03ee4ea0-8141-49ef-b705-bbd18d622ac4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064124 Aug 31 12:23:49.394473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 376/726] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:49.598367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:49.602007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:49.610159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:49.610713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:49.611198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:49.612096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:49.612717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:49.613305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:49.652584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1b5e95f1-2c22-4521-8a61-46bee466c827 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060029 Aug 31 12:23:49.653321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 351/727] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:49.993328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:49.994097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:50.002829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.003484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.004163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.005135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.005784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.006339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.181223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:50.194629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34785426-c4e8-4832-87c8-5f117abfa03d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.205181 Aug 31 12:23:50.195667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 377/728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:49 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:50.220919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:50.220919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:50.229255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.229878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.230408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.231315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.231872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.232499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.396350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:50.405936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c673339c-1c98-4ee1-93f8-0bdd38467d3b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.192304 Aug 31 12:23:50.406706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 352/729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:50.415496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:50.418152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:50.427345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.427890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.428498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.429323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.429921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.430584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.466274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b45b63fb-fe9f-4b83-9ab3-c5ce3a628ea5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059538 Aug 31 12:23:50.466973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 378/730] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:50.667871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:50.670461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:50.679218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.679862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.680339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.681109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:50.681671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:50.682179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:50.727835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f111a4c-3288-421d-a046-fa049028db23 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064832 Aug 31 12:23:50.728456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 353/731] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:51.315028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:51.316191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:51.338433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:51.339047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:51.339839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:51.341910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:51.341910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:51.342636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:51.668424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:51.669574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:51.712077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:51.712975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:51.713789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:51.715552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:51.716480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:51.717260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:52.123977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:52.127653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:52.143659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f946c20-9935-4674-9df8-10457a54ab6e tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.922251 Aug 31 12:23:52.144954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 379/732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:51 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:52.166574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:52.170264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:52.178767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:52.179565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:52.180113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:52.181023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:52.181616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:52.182117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:52.182312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:52.198567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78dfb15f-5569-4565-9591-8ac6083cdd93 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.768413 Aug 31 12:23:52.199701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 354/733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:52.209506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:52.213769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:52.225535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:52.226355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:52.226952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91136531-eead-483b-b649-8cd0a552ef3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069922 Aug 31 12:23:52.227120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:52.227893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 380/734] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:52.228417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:52.229290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:52.229995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:52.294803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78c3d9af-2a67-485e-a534-a59786d2b9a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092911 Aug 31 12:23:52.296284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 355/735] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:53.185119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:53.186302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:53.198716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.199589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.200338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.201696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.202569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.203377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.226731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:53.228260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:53.239930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.241202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.241801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.242774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.244561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.244561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.652380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:53.660663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:53.665766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c1b1ebd-fb0e-4873-94d1-9c1a78e842c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.488028 Aug 31 12:23:53.666709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 381/736] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:53 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:53.673359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:53.677258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:53.681993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-658a5331-59c0-4ee4-8fb2-40daffee9ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.459381 Aug 31 12:23:53.685700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 356/737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:53.689334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.690230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.691374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.692529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:53.692730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.693512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.694540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.695804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:53.707876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.708780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.709530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.710448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:53.710994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:53.711570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:53.750288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c087c07-5f17-4b18-b8ff-01ba51132b5c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082043 Aug 31 12:23:53.750952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 382/738] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:53.767393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-01cf1238-ae39-4210-8f52-d29717802ad0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079940 Aug 31 12:23:53.768074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 357/739] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:54.696652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:54.697547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:54.706338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:54.706996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:54.707680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:54.708494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:54.709007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:54.709485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:54.720957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:54.723093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:54.737745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:54.738557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:54.739659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:54.741182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:54.741946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:54.742648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:54.773299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:55.204919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:55.229362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-956380da-ca77-4d60-855b-f5c09ec9899f tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1366 microversion: 2.1 time: 0.536932 Aug 31 12:23:55.231391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 383/740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:54 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:55.242712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:55.247170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:55.263493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:55.265220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:55.266388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:55.269005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:55.270477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:55.271375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:55.322782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:55.341916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ea8204c3-0cf9-4d0f-9e73-4eb788516ef4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.627199 Aug 31 12:23:55.343498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9398d60a-3ffb-42dd-91fd-f785a4cfb28a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109324 Aug 31 12:23:55.343968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 358/741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:55.351036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 384/742] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:55.361753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:55.366802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:55.376273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:55.376876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:55.377394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:55.378207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:55.378739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:55.379381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:55.423506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8ca58990-152c-4e05-a19d-1a413a829cb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070030 Aug 31 12:23:55.424310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 359/743] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:56.274219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:56.275424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:56.286718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.287632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.288619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.290399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.291272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.292078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.368039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:56.370720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:56.378324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=98 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:56.393185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.394153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.394888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.396745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.398104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.398989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.466378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50e88995-0b90-4d00-a2fd-456e7b3f6f66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107492 Aug 31 12:23:56.466378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 360/744] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:23:56.476685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:56.477910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:56.489410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.490286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.491048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.492489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.495318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.495318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.745829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:56.760641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e3eeba99-c0d7-45b5-baa6-8c940c073109 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1556 microversion: 2.1 time: 0.493894 Aug 31 12:23:56.761510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 385/745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:56 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1556 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:56.770176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:56.773646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:56.784335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.785080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.785733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.786938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.791837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.793329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.862616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91b2a8cb-9b43-460a-ab7a-c5ddff68f4ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099358 Aug 31 12:23:56.864065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 386/746] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:56.873396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:56.873815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:56.887168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.888083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.888817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.891549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:56.892456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:56.893580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:56.929080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:56.946873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9f4d87c-7373-4aac-a36f-1cbadf3275b1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1715 microversion: 2.1 time: 0.477701 Aug 31 12:23:56.948000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 361/747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1715 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:57.051889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6951b57e-82a9-4187-9fdb-f5620ba6bf55 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186738 Aug 31 12:23:57.052803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 387/748] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:23:56 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:57.055896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:57.056678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:57.065935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.066276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.067666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.067972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.068660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.069284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.208435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] HTTP exception thrown: Cannot 'detach_volume' instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda while it is in vm_state rescued Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Request method failure captured: Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments/268124ef-b0ac-4c13-9f73-92bd4a8ec220 HTTP/1.1 Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpCnfPhE60MGW35xsKbWQymLH2VKfbkI8riuoyoErKnTaGSCbSjxJHTp3nA14pCNszMnYLak-gAikA7fQD08O00APmFXBcZXarjQNMSf5drcY4PF0Y3QT7FucqIAXv_g4UWE6nQ-UpiHVrwvs357GiMOlSO1u_7YlmdlMt4jfbLfE Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:23:57.210194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8687bcf9d2a242b5af329bce4a8ad6d9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: a8320be5e9644b6699ac526913e109eb Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:23:57.212369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Cannot 'detach_volume' instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda while it is in vm_state rescued Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'server_id': 'aef8f7f2-486d-4c5d-984f-55bda8e6fbda', 'id': '268124ef-b0ac-4c13-9f73-92bd4a8ec220'} Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:23:57.213188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda while it is in vm_state rescued Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda while it is in vm_state rescued Aug 31 12:23:57.215145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:23:57.217864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Returning 409 to user: Cannot 'detach_volume' instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda while it is in vm_state rescued {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:23:57.219288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c35654d8-f02f-4a09-9f58-9d642861cef8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments/268124ef-b0ac-4c13-9f73-92bd4a8ec220" status: 409 len: 152 microversion: 2.1 time: 0.171801 Aug 31 12:23:57.220408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 362/749] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:23:57 2022] DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments/268124ef-b0ac-4c13-9f73-92bd4a8ec220 => generated 152 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 12:23:57.235180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:57.236183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:57.241638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:23:57.241993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:23:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action (ip 10.222.0.27) !!! Aug 31 12:23:57.250719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.251681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.252502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.253560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.254304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.254834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.398778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d87a7326-f045-4bd3-a1a9-7465433f6233 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action" status: 202 len: 0 microversion: 2.1 time: 0.169809 Aug 31 12:23:57.405318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 388/750] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:23:57 2022] POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:23:57.416605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:57.420649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:57.433570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.435032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.436505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.438425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.439977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.441136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.488342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:57.493052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:57.506419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.507387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.508173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.509462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.510609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.511725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.596770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba1d4523-0621-4c38-a9aa-9efac11d8117 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119270 Aug 31 12:23:57.599549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 389/751] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:57.881320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:57.884053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:57.893799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.896668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.896668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.896668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:57.896668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:57.897706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:57.918285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:57.931828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4791407e-9b04-4864-aa01-a06f68caae94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1723 microversion: 2.1 time: 0.524402 Aug 31 12:23:57.932487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 363/752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1723 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:23:57.944518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4df06555-ef2b-4242-91ec-51b97dfbdb40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068060 Aug 31 12:23:57.945811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 390/753] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:23:58.615584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:58.619204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:58.632916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:58.633817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:58.634409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:58.635720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:58.636537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:58.637278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:58.689129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-716dfec5-e9b7-4574-b106-df81fe2bd9b8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079045 Aug 31 12:23:58.689945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 364/754] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:58.965825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:58.972254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:58.977973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:58.978615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:58.983813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:58.984930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:58.985751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:58.986706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:58.987340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:58.987932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:59.002599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:59.003698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:59.004606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:59.006010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:59.006979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:59.017383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:59.046477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ecc445ea-02f1-4479-b1ab-e1fa7b6a3fc2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086822 Aug 31 12:23:59.047673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 391/755] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:23:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:23:59.058560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-8b5be3d5-24ca-460e-8ec9-35ac3e5bb578 req-aee4f5fc-1302-4d29-b43e-dc9d55a9b4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659e57d5-c27a-45e8-96b5-0a115cec46ee", "tag": "a7e90a3c-3dc3-407f-85aa-1369258bd64b"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:23:59.073978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8b5be3d5-24ca-460e-8ec9-35ac3e5bb578 req-aee4f5fc-1302-4d29-b43e-dc9d55a9b4ec service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:59.074603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8b5be3d5-24ca-460e-8ec9-35ac3e5bb578 req-aee4f5fc-1302-4d29-b43e-dc9d55a9b4ec service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:59.075145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8b5be3d5-24ca-460e-8ec9-35ac3e5bb578 req-aee4f5fc-1302-4d29-b43e-dc9d55a9b4ec service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:59.092140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-8b5be3d5-24ca-460e-8ec9-35ac3e5bb578 req-aee4f5fc-1302-4d29-b43e-dc9d55a9b4ec service nova] Creating event network-changed:a7e90a3c-3dc3-407f-85aa-1369258bd64b for instance 659e57d5-c27a-45e8-96b5-0a115cec46ee on hv-cinder-85535 Aug 31 12:23:59.098161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-8b5be3d5-24ca-460e-8ec9-35ac3e5bb578 req-aee4f5fc-1302-4d29-b43e-dc9d55a9b4ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049069 Aug 31 12:23:59.098974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 392/756] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:23:59.282930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:23:59.301634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-51a634e3-af47-449c-9192-5844ec0d1d72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1723 microversion: 2.1 time: 0.328183 Aug 31 12:23:59.302884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 365/757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:23:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:23:59.711970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:23:59.715665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:23:59.725576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:59.726085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:59.726739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:59.727672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:23:59.728462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:23:59.729252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:23:59.788364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5385a245-2698-4aa5-ad5d-817316910840 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087821 Aug 31 12:23:59.789358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 393/758] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:23:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:00.069390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:00.074409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:00.088236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:00.089048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:00.089770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:00.096092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:00.097226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:00.097923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:00.165994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0ab93abe-0a4f-439d-832b-9d0150a3d4e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101807 Aug 31 12:24:00.167086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 366/759] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:00.341111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:00.343262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:00.355217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:00.355872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:00.356757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:00.357899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:00.358809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:00.359804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:00.613771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:24:00.636620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f64cf8fc-7ec5-4ce1-ab9c-8194886130de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1723 microversion: 2.1 time: 0.302424 Aug 31 12:24:00.638117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 394/760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:24:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:24:00.808639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:00.812493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:00.822192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:00.822693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:00.823153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:00.824859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:00.825555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:00.826174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:00.885746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7d551ae-30db-42e7-a5f4-ca6245802cfa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084023 Aug 31 12:24:00.886722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 367/761] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:01.185462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:01.189252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:01.198526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.198995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.199711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.200676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.201115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.201742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.248679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c405923-66e4-4308-8ce0-c785d1953aa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068831 Aug 31 12:24:01.250201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 395/762] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:01.669889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:01.671744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:01.683553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.687679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.687679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.687679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.687679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.690302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.908190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:01.909487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:24:01.913301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:01.921403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b042481-f3bc-47ce-abf6-875a2fa23e0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1729 microversion: 2.1 time: 0.257489 Aug 31 12:24:01.921989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 368/763] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:24:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:24:01.926837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.927752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.928582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.929915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.930732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.931530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.957354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:01.957877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:01.962067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:01.965975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.966908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.967887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:01.968761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:01.969568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:01.970326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:02.000980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3fbb71ba-ca4f-40e5-bea0-e0129bd700d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102224 Aug 31 12:24:02.002065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 396/764] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:02.104970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9885db20-786a-4ddb-b08c-3dda9505144b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151818 Aug 31 12:24:02.106347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 369/765] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:24:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:02.270475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:02.272913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:02.280028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:02.280539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:02.281035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:02.281756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:02.282231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:02.282638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:02.325019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fb72b9b-a914-41d9-8d5b-b1404c9df10a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060332 Aug 31 12:24:02.325670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 397/766] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:03.019863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:03.022748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:03.031998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:03.032938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:03.033612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:03.034578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:03.035264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:03.035842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:03.081479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5046dd7c-2eb5-4ac5-b932-bd02a655e3c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067061 Aug 31 12:24:03.082363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 370/767] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:03.342877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:03.346319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:03.355580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:03.356230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:03.357036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:03.357961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:03.358790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:03.359419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:03.403017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9dbbfe87-719b-448c-8dff-5eb7917b5a6a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066647 Aug 31 12:24:03.404073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 398/768] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:03.804332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-7c4a9439-6f65-4da1-ba98-a5413a192a31 req-dc842111-a85e-475d-899a-c1f3971cd7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:24:03.827066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-7c4a9439-6f65-4da1-ba98-a5413a192a31 req-dc842111-a85e-475d-899a-c1f3971cd7f3 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:03.828013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-7c4a9439-6f65-4da1-ba98-a5413a192a31 req-dc842111-a85e-475d-899a-c1f3971cd7f3 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:03.829143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-7c4a9439-6f65-4da1-ba98-a5413a192a31 req-dc842111-a85e-475d-899a-c1f3971cd7f3 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:03.859401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-7c4a9439-6f65-4da1-ba98-a5413a192a31 req-dc842111-a85e-475d-899a-c1f3971cd7f3 service nova] Creating event network-changed:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:24:03.873458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-7c4a9439-6f65-4da1-ba98-a5413a192a31 req-dc842111-a85e-475d-899a-c1f3971cd7f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073117 Aug 31 12:24:03.873458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 371/769] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:04.099269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:04.102836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:04.112965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:04.113733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:04.114506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:04.116346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:04.116873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:04.117495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:04.177533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d40d504-a968-41c6-95bf-7cb368c36fb8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085682 Aug 31 12:24:04.178879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 399/770] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:04.429252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:04.440270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:04.460036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:04.463759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:04.467178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:04.469587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:04.470829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:04.471691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:04.522607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24118adb-f209-45ba-8a22-e6ba6ee0f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106463 Aug 31 12:24:04.525949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 372/771] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:05.198857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:05.203532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:05.217153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:05.218053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:05.218873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:05.220368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:05.221188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:05.221942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:05.294197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb173d07-45c7-47e8-a539-970a5e252981 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103774 Aug 31 12:24:05.296514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 400/772] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:05.542993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:05.546221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:05.555604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:05.556424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:05.557195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:05.558065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:05.558645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:05.559177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:05.600036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b1b0194-9e21-4e26-a475-6e1b33e22b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062322 Aug 31 12:24:05.600831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 373/773] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:05.902423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-42684b5b-0f99-419f-8f12-383f0ab25dec req-b8aabf82-792b-4c2e-8042-f5a7d955f124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:24:05.915161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-42684b5b-0f99-419f-8f12-383f0ab25dec req-b8aabf82-792b-4c2e-8042-f5a7d955f124 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:05.915679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-42684b5b-0f99-419f-8f12-383f0ab25dec req-b8aabf82-792b-4c2e-8042-f5a7d955f124 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:05.916363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-42684b5b-0f99-419f-8f12-383f0ab25dec req-b8aabf82-792b-4c2e-8042-f5a7d955f124 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:05.932604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-42684b5b-0f99-419f-8f12-383f0ab25dec req-b8aabf82-792b-4c2e-8042-f5a7d955f124 service nova] Creating event network-changed:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:24:05.942873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-42684b5b-0f99-419f-8f12-383f0ab25dec req-b8aabf82-792b-4c2e-8042-f5a7d955f124 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050188 Aug 31 12:24:05.944226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 401/774] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:06.315870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:06.319400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:06.328109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:06.328786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:06.329330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:06.330309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:06.331064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:06.331724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:06.369747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e757c3c1-a9da-4b58-970b-89c7a6ee2cb6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060613 Aug 31 12:24:06.370864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 374/775] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:06.626786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:06.630355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:06.640875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:06.641603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:06.642085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:06.642886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:06.643463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:06.644014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:06.702593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-33bbb510-405d-431e-9946-207f55ace20c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089228 Aug 31 12:24:06.708884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 402/776] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:07.389932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:07.394370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:07.407037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:07.407711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:07.408360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:07.409447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:07.409953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:07.410459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:07.469391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4175758-1ea5-46ac-95d6-82cfd91a54f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086479 Aug 31 12:24:07.472253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 375/777] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:07.720775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:07.724006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:07.731950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:07.733495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:07.734168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:07.735045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:07.735605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:07.736163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:07.792588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f18cc1d-f7d7-4191-ba35-175ab6537e91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079252 Aug 31 12:24:07.793637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 403/778] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:08.486607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:08.490518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:08.507834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:08.508436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:08.508930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:08.509711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:08.510375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:08.510932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:08.515379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:08.559505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-07c11927-4b57-4b10-96da-a7877fde5481 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077635 Aug 31 12:24:08.560519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 376/779] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:08.810175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:08.812689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:08.815402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=92 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:08.822108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:08.822586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:08.823009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:08.823758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:08.824207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:08.824623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:08.881521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e0d6e5a5-b3a3-4dba-8cf3-5233a2121e2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076680 Aug 31 12:24:08.882503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 404/780] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:09.579414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:09.583387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:09.594160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:09.594634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:09.595076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:09.595996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:09.596456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:09.596883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:09.633408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7582ef8-31ba-4f08-97f8-d8fe0063a80b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061800 Aug 31 12:24:09.634155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 377/781] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:09.900989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:09.904926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:09.916694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:09.917583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:09.918341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:09.919845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:09.920684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:09.921445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:09.965032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b087e62d-db42-4c9e-8978-c02ee1b16496 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071830 Aug 31 12:24:09.965622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 405/782] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:10.649579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:10.652215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:10.664477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:10.668672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:10.668672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:10.668672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:10.668672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:10.669284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:10.727102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-007688b1-0b77-4cc3-9879-3fba7fac8dbf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082857 Aug 31 12:24:10.728158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 378/783] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:10.980250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:10.984967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:10.995542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:10.996184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:10.996922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:10.998129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:10.998965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:10.999766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:11.051404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f543e18-a24f-4c67-8833-2783e2c571bd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077444 Aug 31 12:24:11.052114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 406/784] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:11.746228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:11.750263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:11.764938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:11.765806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:11.766588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:11.767891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:11.768724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:11.769438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:11.827461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d7183bce-af59-4cf8-8efc-ef659f571341 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088167 Aug 31 12:24:11.828136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 379/785] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:12.072938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:12.076739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:12.090201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:12.091127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:12.092444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:12.093492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:12.094299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:12.095159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:12.155408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-830d44b3-e874-4220-89c1-9fc60e201dfb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089905 Aug 31 12:24:12.156483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 407/786] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:12.844800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:12.847568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:12.860122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:12.861006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:12.861779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:12.863033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:12.863888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:12.864646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:12.916497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28758023-5e5a-4996-af32-6df5994a5be6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077785 Aug 31 12:24:12.917317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 380/787] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:13.176335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:13.179591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:13.191180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:13.192077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:13.192821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:13.194065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:13.194869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:13.195652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:13.246028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-be650dc6-1d70-4d4d-b54e-fe12ab417723 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076294 Aug 31 12:24:13.246875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 408/788] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:13.933724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:13.937550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:13.949894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:13.950763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:13.951565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:13.952797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:13.953567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:13.954273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:14.011769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3ae75739-88fd-4843-a027-eca92719d361 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082715 Aug 31 12:24:14.012778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 381/789] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:14.263629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:14.266818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:14.276140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:14.276962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:14.277715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:14.279045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:14.279996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:14.280607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:14.327893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f8dcea9-8a4f-44e9-a98c-6d71bd0d3db4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069341 Aug 31 12:24:14.328731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 409/790] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:15.031605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:15.035417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:15.047068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:15.047960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:15.048724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:15.049992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:15.050788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:15.051562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:15.119208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77c91914-5ae3-4c5c-9a45-b9e4237901a2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095425 Aug 31 12:24:15.120369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 382/791] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:15.348877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:15.352918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:15.366178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:15.367027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:15.367853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:15.369164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:15.370049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:15.370838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:15.431847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-24f14513-bf16-4f88-aa41-02b9fd1e8c53 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091798 Aug 31 12:24:15.432733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 410/792] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:16.137698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:16.140129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:16.149819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:16.150614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:16.151358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:16.152569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:16.153381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:16.154112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:16.206272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-18a8db11-1634-4cb5-9660-f50c3a522438 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074338 Aug 31 12:24:16.206952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 383/793] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:16.450840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:16.454718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:16.466652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:16.467147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:16.467614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:16.468530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:16.468980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:16.469420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:16.505331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-60aff170-f443-4eb9-82d4-a97f0dd1aeab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061682 Aug 31 12:24:16.506022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 411/794] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:17.219460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:17.221928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:17.230080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:17.230708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:17.231410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:17.232307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:17.233092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:17.233789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:17.282048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e08b0f4-5827-4a8c-855e-14744a776f3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066447 Aug 31 12:24:17.283013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 384/795] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:17.522396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:17.526687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:17.540744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:17.541618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:17.542388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:17.543761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:17.544697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:17.545582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:17.610433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c12e2eaf-fd6a-4b7e-9494-a6974dd5daa7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095512 Aug 31 12:24:17.611330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 412/796] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:18.302296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:18.306169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:18.318254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:18.319073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:18.319871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:18.321109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:18.321914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:18.322670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:18.382337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-854160a3-336e-4766-9d63-a87b5fc79333 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087494 Aug 31 12:24:18.383411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 385/797] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:18.624351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:18.626703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:18.634220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:18.634817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:18.635326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:18.636084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:18.636615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:18.637043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:18.676382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:18.684184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c8d99f1-119b-40eb-bf20-286923b15374 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064251 Aug 31 12:24:18.684841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 413/798] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:19.400046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:19.402533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:19.410349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:19.410835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:19.411289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:19.411991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:19.412428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:19.412841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:19.458386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c301aa03-6a51-4ac5-8b27-bebd37fc8f1e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063047 Aug 31 12:24:19.458976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 386/799] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:19.703035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:19.707055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:19.720256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:19.721169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:19.721992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:19.723314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:19.724070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:19.724780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:19.785114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf049207-a57b-4606-a1c1-247283ae8c20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090238 Aug 31 12:24:19.786203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 414/800] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:20.474538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:20.478381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:20.490583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:20.491328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:20.492110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:20.493369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:20.494196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:20.494903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:20.536684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f0c04c6b-a0eb-4a15-a1fa-75007d5b31a8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069627 Aug 31 12:24:20.537300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 387/801] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:20.808967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:20.813761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:20.827265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:20.828184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:20.828899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:20.830526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:20.831364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:20.832095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:20.892147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5828f406-90ea-4a75-aca6-c82c330ac64b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092357 Aug 31 12:24:20.893373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 415/802] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:21.553427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:21.555713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:21.563533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:21.564084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:21.564573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:21.565426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:21.565976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:21.566482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:21.605440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5ad77a40-870d-4698-a70b-7ba3997f15fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056009 Aug 31 12:24:21.606316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 388/803] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:21.912165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:21.916389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:21.929046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:21.929880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:21.930585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:21.931930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:21.932757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:21.933462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:21.999189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f8cfdb1-20db-4a21-bcf4-e43986e7eb9b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094126 Aug 31 12:24:22.000300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 416/804] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:22.621851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:22.625171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:22.632622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:22.633123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:22.633635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:22.634376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:22.634839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:22.635378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:22.676646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-42d3726c-e739-4d3d-9b8c-91511e708d15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059516 Aug 31 12:24:22.677261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 389/805] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:23.016979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:23.019492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:23.027626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:23.028161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:23.028985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:23.029934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:23.030446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:23.030921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:23.069743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26ef5b1d-9709-4482-a279-b619910c4bc5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056869 Aug 31 12:24:23.070295 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 417/806] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:23.693159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:23.695469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:23.705514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:23.706349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:23.706888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:23.707851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:23.708535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:23.709057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:23.761968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b26b3211-464a-4cc2-9791-ffcf63c32f8d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072842 Aug 31 12:24:23.763503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 390/807] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:24.087319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:24.089690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:24.097683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:24.098177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:24.098618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:24.099405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:24.099883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:24.100442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:24.147737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c0772cd-8c41-4617-bb3b-f8282eee95f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063950 Aug 31 12:24:24.149038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 418/808] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:24.779633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:24.782118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:24.790009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:24.790577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:24.791101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:24.791953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:24.792470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:24.792944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:24.833335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3eb6528-c9e9-4398-b715-801a5240a548 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058054 Aug 31 12:24:24.834040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 391/809] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:25.167399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:25.170686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:25.180293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:25.180875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:25.181364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:25.182160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:25.182666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:25.183140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:25.222147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ce12dab-3e40-4333-a956-486abdab66ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060568 Aug 31 12:24:25.222854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 419/810] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:25.849912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:25.852782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:25.864168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:25.864922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:25.865602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:25.866737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:25.867493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:25.868158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:25.905867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:25.912513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe454ca3-e3c4-4928-ba4e-f75c20f094af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066795 Aug 31 12:24:25.913532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 392/811] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:26.239872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:26.243634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:26.255607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:26.256461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:26.257224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:26.258458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:26.259288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:26.260053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:26.319887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7479e9c2-88b5-4968-856f-742af2b321cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087299 Aug 31 12:24:26.320994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 420/812] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:26.926412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:26.929472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:26.932597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=66 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:26.939490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:26.940112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:26.940599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:26.941486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:26.941981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:26.942558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:26.977152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83e53ae1-3e34-45b9-b497-60f32998bd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055001 Aug 31 12:24:26.977846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 393/813] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:27.335553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:27.338056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:27.345979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:27.346531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:27.347148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:27.347889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:27.348387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:27.348863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:27.398756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f70ed406-7620-47cc-9f76-44bfc130f489 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067779 Aug 31 12:24:27.399441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 421/814] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:27.993326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:27.996171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:28.005432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:28.006112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:28.006665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:28.007504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:28.008430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:28.009004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:28.052884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0d573f0-4a95-487e-8327-42f9c0c700ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066200 Aug 31 12:24:28.053699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 394/815] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:28.416879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:28.420696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:28.432916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:28.433765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:28.434678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:28.435915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:28.436747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:28.437480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:28.499832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4607f93a-fc56-487f-a26e-53aa3162b511 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090430 Aug 31 12:24:28.500892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 422/816] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:29.069498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:29.072219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:29.082059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:29.082910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:29.083758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:29.084975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:29.085750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:29.086477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:29.134274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06e6dedf-92c3-4348-8f4a-31c69dee0c10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071622 Aug 31 12:24:29.134933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 395/817] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:29.522122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:29.524570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:29.533351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:29.534233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:29.535569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:29.536312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:29.537116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:29.540295 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:29.580575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8cecb643-d689-4a4d-86db-d41a8e9693ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063368 Aug 31 12:24:29.581898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 423/818] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:30.150472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:30.153169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:30.160710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:30.161334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:30.161860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:30.163016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:30.163751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:30.164378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:30.202895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-035f1c6e-2ccf-4acf-b809-a1aaf002a56b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056645 Aug 31 12:24:30.203751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 396/819] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:30.596402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:30.598775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:30.610390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:30.611166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:30.611962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:30.613302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:30.614136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:30.614896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:30.672934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66ed4f85-ce8a-419a-8775-2eff196f37e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080406 Aug 31 12:24:30.673870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 424/820] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:31.223571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:31.227460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:31.239610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:31.240443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:31.241212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:31.242531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:31.243391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:31.244135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:31.301296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d63befca-f7f9-4d54-bcef-6578357e65e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086010 Aug 31 12:24:31.302360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 397/821] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:31.690809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:31.693528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:31.702036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:31.702670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:31.703197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:31.704049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:31.704592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:31.705112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:31.744554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0af83c17-b6b6-4167-8765-65440da5552d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059525 Aug 31 12:24:31.745314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 425/822] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:32.318060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.320574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:32.329454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:32.330006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:32.330537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:32.331356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:32.331861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:32.332324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:32.369334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8746a0bf-58d3-4cec-b30d-f3a3362e8871 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055631 Aug 31 12:24:32.369809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 398/823] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:32.758415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:32.761123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:32.769582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:32.770076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:32.770507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:32.771307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:32.771811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:32.772216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:32.824661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-17f14ed5-fc73-4f14-bcb6-afe2930c73bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070201 Aug 31 12:24:32.825709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 426/824] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:33.383613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:33.387506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:33.396302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:33.397015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:33.397797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:33.398873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:33.399674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:33.400275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:33.438103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8095856e-1dbc-4760-970a-79609ea9fbfb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059367 Aug 31 12:24:33.438704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 399/825] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:33.841676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:33.844066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:33.852943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:33.853413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:33.853866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:33.854611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:33.855166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:33.855666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:33.909560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-10bac24c-7825-49a0-a8e2-e92a28dce475 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071761 Aug 31 12:24:33.910537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 427/826] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:34.455448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:34.457821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:34.466968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:34.467625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:34.468309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:34.469276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:34.469778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:34.470283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:34.510928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a30be314-7030-451c-9c8f-07dc38f3052b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060338 Aug 31 12:24:34.512003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 400/827] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:34.928507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:34.932166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:34.944781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:34.945597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:34.946302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:34.947546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:34.948320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:34.949029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:35.009288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb43ca16-c2c3-4cd7-95aa-f6278a306cae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087523 Aug 31 12:24:35.010358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 428/828] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:35.531566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:35.535608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:35.547848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:35.548747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:35.549454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:35.550800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:35.551676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:35.552424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:35.610558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-452c486d-649b-4264-895e-9a75ad29c97e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086534 Aug 31 12:24:35.611710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 401/829] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:36.006902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:36.007897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:36.015730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:36.016394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:36.016883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:36.017682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:36.018271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:36.018744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:36.030685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:36.034600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:36.046209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:36.047104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:36.047905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:36.049187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:36.049987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:36.050832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:36.051370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d7bdcba8-8a43-4cdc-bc4b-ada9e95b4dbf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee/ips" status: 200 len: 150 microversion: 2.1 time: 0.049099 Aug 31 12:24:36.051968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 429/830] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:24:36 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:36.099163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f01aa4ab-0cc7-4409-b8f6-df72c41545c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074931 Aug 31 12:24:36.100152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 402/831] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:36.629546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:36.632677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:36.641147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:36.641840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:36.642442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:36.643204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:36.643687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:36.644114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:36.675718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:36.684233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-16c8196a-c4bc-45df-b07e-8da9acb98bd3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059870 Aug 31 12:24:36.685077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 430/832] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:37.117298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:37.120887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:37.132709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:37.133506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:37.134190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:37.135404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:37.136167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:37.136836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:37.193553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4b01e21-412f-403b-bb72-631f508e876c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082832 Aug 31 12:24:37.194384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 403/833] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:37.703964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:37.707133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:37.718005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:37.718754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:37.719512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:37.720749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:37.721524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:37.722252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:37.765416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c9fde553-7ddb-44f3-8e4f-82df4c269342 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068350 Aug 31 12:24:37.765972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 431/834] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:38.211555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:38.213767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:38.222222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:38.223020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:38.223791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:38.225011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:38.225671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:38.226360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:38.286186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1bbb0c55-920d-46a4-bd3b-45b0463da910 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079012 Aug 31 12:24:38.287217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 404/835] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:38.780082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:38.782678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:38.791287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:38.791778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:38.792264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:38.793199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:38.793865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:38.794383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:38.846629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-95916bcb-b950-4c28-aab2-6b460ef16783 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071031 Aug 31 12:24:38.847577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 432/836] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:39.306347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:39.310244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:39.322145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:39.322954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:39.323762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:39.324815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:39.325634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:39.326389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:39.386688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-38f3087a-8c27-45e6-ae76-35b6a67037dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087314 Aug 31 12:24:39.387813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 405/837] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:39.863136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:39.865431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:39.868301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=58 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:39.875614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:39.876135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:39.876547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:39.877326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:39.877802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:39.878235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:39.914981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-596901b9-f666-4809-a8c9-4d7206485763 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056140 Aug 31 12:24:39.915654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 433/838] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:40.408325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:40.412388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:40.425288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:40.426060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:40.426884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:40.428330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:40.429195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:40.429984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:40.488516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-72217bb0-5bfb-40fe-92f1-16908a407de6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088047 Aug 31 12:24:40.489572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 406/839] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:40.933362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:40.936187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:40.946625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:40.947528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:40.948288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:40.949582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:40.950365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:40.951100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:41.010179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18985bd4-1185-4e70-a87f-b39d9d9a2f16 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085292 Aug 31 12:24:41.011030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 434/840] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:41.509555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:41.513539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:41.526372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:41.527409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:41.528248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:41.529815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:41.530713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:41.531544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:41.590141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc39098b-2ab5-4a30-a091-343ed224a493 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087300 Aug 31 12:24:41.591522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 407/841] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:41.656850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:41.657865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:41.671706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:41.672908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:41.673743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:41.675266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:41.676233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:41.677108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.005456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'services' on Instance uuid aef8f7f2-486d-4c5d-984f-55bda8e6fbda {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:24:42.031569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:42.034219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:42.043213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:42.043898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:42.044575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.045550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:42.046176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:42.046710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.106309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-30b283d2-4a4b-488d-b06b-cb6d3254e585 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083308 Aug 31 12:24:42.107478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 408/842] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:42.139773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4e1b7f2d-19aa-4c81-9dea-56d016c50111 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments/268124ef-b0ac-4c13-9f73-92bd4a8ec220" status: 202 len: 0 microversion: 2.1 time: 0.491253 Aug 31 12:24:42.140559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 435/843] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:24:41 2022] DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments/268124ef-b0ac-4c13-9f73-92bd4a8ec220 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:24:42.154139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:42.158534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:42.171788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:42.172731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:42.173515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.175774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:42.175774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:42.176691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.207768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:42.247730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de2712ed-3ee7-401d-bd2a-fe6295376357 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101131 Aug 31 12:24:42.248855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 409/844] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:42.611007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:42.615390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:42.624467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:42.625388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:42.626208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.627808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:42.628380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:42.628832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:42.674650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4914e406-66bc-4823-b640-52e0c305bac1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071007 Aug 31 12:24:42.675553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 436/845] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:43.124416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:43.127674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:43.137667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:43.138194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:43.138708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:43.139511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:43.139987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:43.140413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:43.180184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9169ebb1-1b55-4608-9914-e0c5ba84add5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062127 Aug 31 12:24:43.180696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 410/846] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:43.262912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:43.265621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:43.274021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:43.274552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:43.275017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:43.275848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:43.276339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:43.276784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:43.319052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb71b6c9-d6e0-4900-b0f6-b1a5229cc020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060371 Aug 31 12:24:43.320147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 437/847] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:43.691872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:43.695768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:43.704621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:43.705405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:43.706105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:43.707507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:43.708031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:43.708749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:43.765758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50738b70-e22b-401f-a0fc-a8eefa1ee13a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079821 Aug 31 12:24:43.766976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 411/848] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:44.196357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:44.199271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:44.207640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:44.208171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:44.208729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:44.209564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:44.210090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:44.210577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:44.250251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b602547-1a9f-4eca-bb7d-a57c1a134a55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058919 Aug 31 12:24:44.250969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 438/849] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:44.339731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:44.343587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:44.352848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:44.353705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:44.354415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:44.355161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:44.355728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:44.356150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:44.405569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-43f01b93-1ee8-4a9d-abc4-0ed52db679da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073913 Aug 31 12:24:44.406483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 412/850] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:44.785437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:44.789427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:44.800058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:44.800936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:44.802548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:44.803739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:44.804467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:44.805127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:44.865225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a7974111-4b18-4147-a23f-7a547adc7068 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086177 Aug 31 12:24:44.866676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 439/851] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:45.267158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:45.271701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:45.294714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:45.295603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:45.296369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:45.297620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:45.298479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:45.299486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:45.357953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e87d2073-5195-4fd2-b892-ec346ec0e0c1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097429 Aug 31 12:24:45.360202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 413/852] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:45.426296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:45.431361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:45.442233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:45.443123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:45.443933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:45.445328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:45.446405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:45.447148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:45.501057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e0475ad-72b7-4f33-ba72-8cedf6ac8d0d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083263 Aug 31 12:24:45.502012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 440/853] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:45.884851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:45.887510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:45.902030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:45.903345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:45.904015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:45.904899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:45.905466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:45.906014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:45.946944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40c4aced-3adf-4d1f-9105-a848d5f4402b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069769 Aug 31 12:24:45.947591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 414/854] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:46.376606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:46.379512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:46.388043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:46.388770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:46.389352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:46.390217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:46.390805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:46.391464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:46.439571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-81fe7d7d-f7f0-4e7d-aceb-e68a198a1d70 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069553 Aug 31 12:24:46.440633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 441/855] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:46.514633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:46.517076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:46.525261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:46.525777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:46.526222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:46.526957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:46.527696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:46.527696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:46.568603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5eeafa73-b04d-4543-8325-ad2d48183a9e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058162 Aug 31 12:24:46.569398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 415/856] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:46.963762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:46.966749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:46.974056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:46.974814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:46.975466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:46.976281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:46.976876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:46.977547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:47.015337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a7db9035-289d-47ca-a420-a512c9de1764 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057127 Aug 31 12:24:47.015927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 442/857] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:47.456930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:47.460830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:47.473487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:47.474337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:47.475062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:47.476289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:47.477096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:47.477802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:47.545452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-490c06ba-705c-47c5-a1bd-06b8326cfd66 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095569 Aug 31 12:24:47.546522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 416/858] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:47.582506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:47.584959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:47.593245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:47.595670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:47.595670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:47.595670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:47.595670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:47.596558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:47.640182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-51956a2c-af5c-404f-9a02-3b4b8b38079b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061959 Aug 31 12:24:47.640828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 443/859] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:48.032517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:48.035016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:48.045310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:48.046041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:48.046621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:48.047678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:48.048238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:48.048754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:48.094711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f4404af8-72d3-4654-b3f8-13dce447b7ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069330 Aug 31 12:24:48.095436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 417/860] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:48.561747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:48.564106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:48.570952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:48.571473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:48.571909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:48.572633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:48.573086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:48.573505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:48.616192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58cd1468-5288-4266-93d4-f42f7aab2385 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059024 Aug 31 12:24:48.617428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 444/861] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:48.655670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:48.659120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:48.667101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:48.668017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:48.668629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:48.669598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:48.670313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:48.670845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:48.720785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22bfb17e-0948-434e-9f0a-5cde7e7d87cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070355 Aug 31 12:24:48.721516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 418/862] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:49.109194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:49.111665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:49.119110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:49.119704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:49.120188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:49.121134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:49.122439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:49.122439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:49.164424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a4d4a10-28ea-48a0-9e56-3a8006f11157 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060084 Aug 31 12:24:49.165028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 445/863] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:49.633078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:49.636724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:49.647752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:49.648618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:49.649387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:49.650692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:49.651549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:49.652362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:49.713753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2c6db59e-4310-4662-a014-436edb0beb45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087575 Aug 31 12:24:49.715809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 419/864] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:49.735025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:49.737944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:49.745918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:49.746819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:49.747424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:49.748175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:49.748642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:49.749072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:49.785565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:49.795074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eeb121ad-7c5d-4ed2-b9d7-63cf7beffef5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064797 Aug 31 12:24:49.795772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 446/865] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:50.182662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:50.186661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:50.198915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:50.199816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:50.200590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:50.201880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:50.202700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:50.203466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:50.264617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de4a8716-50f1-4564-8b66-b77e1dc66daf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088846 Aug 31 12:24:50.265657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 420/866] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:50.731524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:50.733847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:50.742357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:50.743098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:50.743291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:50.744224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:50.744685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:50.745105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:50.790108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3c722067-8dfb-4942-b928-f01d0472e421 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063375 Aug 31 12:24:50.790964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 447/867] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:50.812707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:50.816646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:50.828751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:50.829623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:50.830415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:50.831788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:50.832610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:50.833371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:50.888595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-54ebe07b-4524-4f0a-86f4-4fc1a07d3d71 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083445 Aug 31 12:24:50.889502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 421/868] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:51.283328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:51.286939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:51.295922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:51.296462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:51.297118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:51.298287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:51.298863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:51.299406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:51.343188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40ed8ca2-c5de-4610-b335-36fb60231961 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065748 Aug 31 12:24:51.343984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 448/869] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:51.807930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:51.811814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:51.823296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:51.824254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:51.824900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:51.826095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:51.826849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:51.827621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:51.887819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26d005f0-619a-46d3-99ad-f8609334f25e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086290 Aug 31 12:24:51.888794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 422/870] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:51.910170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:51.914341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:51.926123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:51.926953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:51.927657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:51.928839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:51.929565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:51.930242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:51.990077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bbc0729d-ae0b-4417-b5dd-fa414c285917 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087459 Aug 31 12:24:51.990981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 449/871] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:52.357490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:52.360147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:52.368214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:52.368977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:52.369601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:52.370603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:52.371182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:52.371984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:52.413892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-943084f2-d204-4f55-b396-c4667aa19b0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060627 Aug 31 12:24:52.415937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 423/872] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:24:52.905851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:52.909567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:52.920014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:52.921057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:52.921612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:52.922665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:52.923141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:52.923683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:52.977915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-29e448a0-859a-419c-903b-56ad713be586 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076843 Aug 31 12:24:52.978949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 450/873] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:53.010175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:53.015109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:53.028116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:53.028988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:53.029775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:53.031110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:53.031904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:53.032665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:53.101204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80ecb6d4-20cc-4991-b352-22a968698154 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098302 Aug 31 12:24:53.102242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 424/874] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:53.434841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:53.438729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:53.451448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:53.452285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:53.453040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:53.454310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:53.455146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:53.455964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:53.516263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5f5b72aa-f1b1-42b6-8736-fd60e2e79977 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089113 Aug 31 12:24:53.517239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 451/875] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:53.993642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:53.997201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:54.005015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:54.005663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:54.006306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:54.007260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:54.007827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:54.008374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:54.046650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c350e80c-bd97-4304-a7b4-15a129731c50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057276 Aug 31 12:24:54.047687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 425/876] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:54.117629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:54.119857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:54.127515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:54.128107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:54.128604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:54.129559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:54.130058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:54.130517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:54.189217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-078ca439-8094-4fe3-9eaa-6667dc18173b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075982 Aug 31 12:24:54.190208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 452/877] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:54.534190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:54.536945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:54.545773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:54.546419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:54.547072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:54.547975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:54.548567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:54.549031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:54.552818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:54.593514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-210e2a52-7ab8-4fc4-82f6-abb519caf0f3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064398 Aug 31 12:24:54.594255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 426/878] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:55.062293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:55.065159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:55.072532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:55.073209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:55.074154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:55.075247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:55.075912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:55.076489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:55.117368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0eb31765-0f7e-4df5-a734-6b28764df4ed tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060345 Aug 31 12:24:55.118132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 453/879] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:24:55.208230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:55.211928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:55.224031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:55.225332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:55.226100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:55.227357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:55.228196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:55.228933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:55.281486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f85cf29c-8eef-4b53-b69e-8e41865c8be0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080915 Aug 31 12:24:55.282687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 427/880] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:55.614936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:55.619352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:55.633886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:55.634810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:55.635802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:55.637538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:55.638644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:55.640032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:55.699707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12722fa9-1aec-4d01-8f2d-b30149b23b5f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091666 Aug 31 12:24:55.700620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 454/881] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:56.135147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:56.138404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:56.148965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:56.149553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:56.150228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:56.151401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:56.152163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:56.152765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:56.205668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b1c32fc1-93a3-447f-a494-ebdf197b17d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076726 Aug 31 12:24:56.206514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 428/882] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:56.304549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:56.308444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:56.319083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:56.319946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:56.320688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:56.321895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:56.322687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:56.323470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:56.371953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99c5b277-e1ac-48b9-9922-285622e52576 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075786 Aug 31 12:24:56.372719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 455/883] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:56.719467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:56.723272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:56.735959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:56.736759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:56.737476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:56.738662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:56.739481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:56.740192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:56.778665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a26b0414-fa0d-47ca-85bd-4ea0c832db42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066525 Aug 31 12:24:56.779557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 429/884] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:57.222446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:57.225979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:57.238082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:57.238894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:57.240150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:57.240951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:57.242282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:57.242434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:57.288019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0a566d5-38b5-4d37-af9c-c2a86daa2daf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072388 Aug 31 12:24:57.288803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 456/885] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:57.389811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:57.394136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:57.398617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=74 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:57.408903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:57.409632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:57.410231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:57.411098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:57.411716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:57.412640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:57.478074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a9869d30-ee0b-475b-8a2d-9c53d663896d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095906 Aug 31 12:24:57.479196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 430/886] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:57.800363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:57.804334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:57.820281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:57.821147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:57.821905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:57.824059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:57.824983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:57.825750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:57.887966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4e73745-1308-45e5-af7d-328654ab0944 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097013 Aug 31 12:24:57.889065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 457/887] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:58.305906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:58.308536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:58.316723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:58.317310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:58.317791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:58.318617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:58.324444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:58.324444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:58.364796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0418d110-51f4-4a2c-99ef-913cb03baa8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063370 Aug 31 12:24:58.365775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 431/888] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:58.494398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:58.497600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:58.505691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:58.506587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:58.507096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:58.508383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:58.508916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:58.509451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:58.573165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a4e52a66-a25e-4e91-a6bf-c3af16e7c0a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082094 Aug 31 12:24:58.574302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 458/889] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:58.908984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:58.913845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:58.927176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:58.928243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:58.929103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:58.930553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:58.931535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:58.932414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:59.003450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd5165ec-ef87-4b0b-a2e4-31339cb34e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103156 Aug 31 12:24:59.004511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 432/890] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:24:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:24:59.381676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:59.384382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:59.392341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:59.393027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:59.393582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:59.394635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:59.395513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:59.396123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:59.459748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e643603-af3f-406e-9a58-55e9ae0c9aba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081469 Aug 31 12:24:59.460588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 459/891] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:24:59.598752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:24:59.603026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:24:59.624985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:59.625880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:59.626679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:59.630939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:24:59.630939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:24:59.630939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:24:59.707030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2671c236-abd9-4dc1-9410-5da4b3118e12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118922 Aug 31 12:24:59.708134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 433/892] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:24:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:00.020909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:00.023418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:00.033088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:00.033665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:00.035048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:00.035048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:00.035598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:00.036123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:00.075919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-55c8bc5a-aa86-4916-ad60-cbc39f3f4f31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059468 Aug 31 12:25:00.076530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 460/893] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:00.633699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:00.638217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:00.654622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:00.654622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:00.655133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:00.656585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:00.657459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:00.658249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:00.719617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0cb96213-bf66-41db-8aaa-d96f284a861a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247845 Aug 31 12:25:00.720261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 434/894] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:00.730466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:00.734538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:00.746213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:00.747219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:00.748127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:00.749522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:00.750496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:00.751163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:00.813785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3a1b2ac3-fda3-4587-9c4c-8fc4ff9916b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090825 Aug 31 12:25:00.814869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 461/895] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:01.101186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:01.103562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:01.122967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:01.123674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:01.124693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:01.125948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:01.126738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:01.127507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:01.192278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac7066e9-fa95-4fb9-96e7-3235e54d2502 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096004 Aug 31 12:25:01.193474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 435/896] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:01.741730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:01.744324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:01.753882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:01.754692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:01.755203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:01.756894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:01.757136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:01.757553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:01.800624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66bbaf85-da81-45c1-87d6-9fb2ce3f709a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066772 Aug 31 12:25:01.801217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 462/897] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:01.830665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:01.833595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:01.841636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:01.842128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:01.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:01.843474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:01.843934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:01.844355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:01.883573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89a73e7f-daad-4bf9-9dd3-cf6d8629b6ec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057177 Aug 31 12:25:01.884418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 436/898] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:02.210164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:02.212989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:02.220087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:02.220587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:02.221015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:02.221721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:02.222162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:02.222577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:02.238345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:02.258103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-61c7e934-3454-4916-bd45-3d9251ee9da9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052918 Aug 31 12:25:02.259028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 463/899] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:02.818642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:02.822517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:02.834345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:02.835741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:02.836021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:02.837421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:02.838349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:02.839316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:02.901573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:02.902454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-754d4b61-e18f-4834-b012-c306aa8755bf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090465 Aug 31 12:25:02.902454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 437/900] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:02.905617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:02.919211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:02.920138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:02.920926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:02.922601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:02.923648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:02.924422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:02.984257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb4b742d-ec16-4e1a-ac02-b9498258fad4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089925 Aug 31 12:25:02.985317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 464/901] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:03.274991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:03.278792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:03.288998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:03.289766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:03.290460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:03.291661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:03.293022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:03.293720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:03.347886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-41057d5c-99bd-4403-a922-4d574730f58b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079539 Aug 31 12:25:03.348775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 438/902] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:03.920278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:03.923836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:03.931929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:03.932451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:03.932914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:03.933642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:03.934119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:03.934525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:03.982102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ea5982e-9bf4-4fe1-9ac7-bc54df057934 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069363 Aug 31 12:25:03.983152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 465/903] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:04.006044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:04.010585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:04.026920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:04.026920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:04.026920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:04.027609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:04.027864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:04.028619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:04.078142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a929a3e2-b149-41e9-a531-76491fc728d5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079427 Aug 31 12:25:04.079107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 439/904] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:04.366196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:04.369785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:04.380515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:04.381285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:04.381971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:04.383113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:04.383868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:04.384547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:04.440757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3656d1bb-2bc2-462b-8c2d-2da5a6e03b25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081203 Aug 31 12:25:04.441677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 466/905] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:05.000105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:05.004057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:05.015053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:05.017859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:05.018560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:05.019819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:05.020602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:05.021358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:05.089105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-99ed515f-0643-4902-bf11-98c13e0b62d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095856 Aug 31 12:25:05.090114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 440/906] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:05.099315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:05.103198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:05.117420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:05.118167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:05.118905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:05.121014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:05.121859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:05.122567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:05.175633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3cc872fc-707f-4160-a944-82d67da64cf4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081485 Aug 31 12:25:05.176534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 467/907] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:05.456942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:05.459082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:05.466403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:05.466913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:05.467386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:05.468112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:05.468686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:05.469110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:05.504713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cafa7cb1-209b-41a4-b992-71a540b2affd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051947 Aug 31 12:25:05.505734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 441/908] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:06.108196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:06.111274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:06.119062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:06.119701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:06.120382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:06.121108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:06.121462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:06.121935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:06.180543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ef42253d-f053-49fb-bbe5-007152b666d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077598 Aug 31 12:25:06.181447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 468/909] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:06.195855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:06.199934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:06.212087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:06.212896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:06.213729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:06.215047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:06.215896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:06.216656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:06.269818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:06.280689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-accbfe08-cd98-4d79-bd5d-bbde5565d941 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092505 Aug 31 12:25:06.281783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 442/910] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:06.523498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:06.527481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:06.538842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:06.539747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:06.540533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:06.541865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:06.542869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:06.543655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:06.588361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04835e91-29a1-4bdd-9d90-f2aeed8eb427 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072413 Aug 31 12:25:06.589081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 469/911] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:07.202287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:07.206191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:07.218321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:07.219181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:07.219969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:07.221229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:07.222040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:07.222772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:07.281532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-27020c31-6653-4600-b3f3-d5f5b51113c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086558 Aug 31 12:25:07.282558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 443/912] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:07.298653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:07.301226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:07.310300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:07.310941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:07.311541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:07.312568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:07.313168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:07.313819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:07.361035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65a84da2-63f4-426b-a029-34f65ca35bf8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067069 Aug 31 12:25:07.361735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 470/913] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:07.603982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:07.606816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:07.613644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:07.614158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:07.614594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:07.615349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:07.615848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:07.616281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:07.658629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-403c8b8e-aa4f-4f21-8a80-6c193d67de7c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059099 Aug 31 12:25:07.659379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 444/914] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:08.301947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:08.306185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:08.318726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:08.319592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:08.320380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:08.321691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:08.322500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:08.323278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:08.384343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73136d2f-813a-4a99-9933-e2c84dd3c389 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089447 Aug 31 12:25:08.385467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 471/915] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:08.387276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:08.391353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:08.404142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:08.404873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:08.405551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:08.406706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:08.407574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:08.408331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:08.462722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8f4a176-3252-4dd1-aa77-f05a2821014a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083162 Aug 31 12:25:08.463877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 445/916] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:08.673609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:08.676258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:08.684219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:08.685277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:08.685722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:08.686467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:08.686927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:08.687388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:08.731257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3d1ed517-bc5c-4f21-b10a-bc2a1673799e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062032 Aug 31 12:25:08.731866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 472/917] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:09.404988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:09.408735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:09.421123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:09.421963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:09.422711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:09.424083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:09.424867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:09.425611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:09.482221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:09.485864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:09.487061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-138e60a4-b670-4c8b-8a31-8c790de22202 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089239 Aug 31 12:25:09.488037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 446/918] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:09.497641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:09.498462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:09.499197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:09.500442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:09.501207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:09.501967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:09.558759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea8f99b0-a9cc-40eb-8220-6bcbc9db8c80 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083626 Aug 31 12:25:09.560047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 473/919] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:09.746672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:09.759046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:09.766477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:09.767115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:09.767652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:09.768425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:09.768925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:09.769383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:09.817194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b95ccc59-52fa-4ee1-baa2-d00c208a2c0b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075577 Aug 31 12:25:09.817869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 447/920] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:10.505869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:10.509873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:10.514125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=82 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:10.524268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:10.525153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:10.525931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:10.527224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:10.528101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:10.528907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:10.579142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:10.583159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:10.590081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcf2adf6-39c3-4a16-a79c-de72dc4f7670 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091621 Aug 31 12:25:10.591310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 474/921] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:10.595792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:10.596661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:10.597434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:10.598751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:10.599849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:10.600618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:10.662630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ecf31c76-f7f6-45a4-9597-36312558f98d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090382 Aug 31 12:25:10.663817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 448/922] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:10.838351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:10.840992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:10.851097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:10.851911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:10.852357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:10.853603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:10.854398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:10.854871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:10.909304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ef755f23-307f-4602-9d78-dd4d490da94c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076041 Aug 31 12:25:10.910368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 475/923] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:11.611702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:11.615309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:11.627828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:11.628670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:11.629413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:11.630689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:11.631523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:11.632249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:11.682090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:11.685890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:11.694725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b5fb1ab-8168-43d3-9050-3c9dc8711737 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090580 Aug 31 12:25:11.695767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 449/924] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:11.699434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:11.700309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:11.701070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:11.702328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:11.703156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:11.703940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:11.768726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-37a80947-62f0-4b61-a263-07ef96d11500 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093637 Aug 31 12:25:11.769763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 476/925] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:11.927821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:11.930174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:11.938317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:11.938815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:11.939281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:11.940020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:11.940479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:11.940901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:11.984795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9e87b6ff-18bf-4b5f-a619-162f2a06acee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061416 Aug 31 12:25:11.985499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 450/926] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:12.709543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:12.711836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:12.724590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:12.725487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:12.726274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:12.727654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:12.728515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:12.729643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:12.788761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:12.792400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc4477da-a0a6-40d8-bd5c-7eaf973ea19b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086918 Aug 31 12:25:12.792950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:12.796276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 477/927] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:12.805132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:12.805995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:12.806596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:12.807967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:12.808706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:12.809406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:12.849537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-52b561ea-7976-4b6a-802b-08a3ce186d10 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067882 Aug 31 12:25:12.850501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 451/928] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:13.008660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:13.012932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:13.024226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:13.025134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:13.027024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:13.028421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:13.029265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:13.030042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:13.094011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e60b79aa-22c1-4fb3-9359-bab23848bfd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092932 Aug 31 12:25:13.095049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 478/929] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:13.812555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:13.816257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:13.829197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:13.830501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:13.830501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:13.831609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:13.832364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:13.833020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:13.869851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:13.874443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:13.882014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b627ba03-6933-42ab-af96-e31d38900d6a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076976 Aug 31 12:25:13.882934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 452/930] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:13.890099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:13.891160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:13.892048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:13.893352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:13.894143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:13.894854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:13.960840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3eb9d592-611e-4122-9d4d-b0626b3d7874 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098538 Aug 31 12:25:13.961946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 479/931] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:14.114296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:14.117551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:14.128192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:14.128943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:14.129622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:14.130760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:14.131521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:14.132179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:14.190257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1fa5e205-5040-4a4e-8723-bc2d7e644ba1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083004 Aug 31 12:25:14.191174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 453/932] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:14.900305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:14.903318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:14.912359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:14.913061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:14.913604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:14.914634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:14.915289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:14.915876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:14.919753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:14.961160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fade0ca7-1edb-42b2-b035-9df5ee250bc5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065434 Aug 31 12:25:14.962055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 480/933] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:14.979809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:14.982214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:14.989730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:14.990227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:14.990669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:14.991480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:14.991952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:14.992384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:15.041612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f9e753a-4a38-440e-866f-016b2d83449d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066804 Aug 31 12:25:15.042383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 454/934] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:15.210828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:15.215003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:15.224264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:15.224967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:15.225515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:15.226389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:15.227008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:15.227615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:15.269368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54150674-a40a-485c-8278-9448f77599c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065938 Aug 31 12:25:15.270028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 481/935] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:15.981527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:15.985529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:15.998776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:15.999746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:16.000585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:16.001910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:16.002760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:16.003600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:16.059136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:16.064199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:16.072671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f69ee963-a8a5-498c-85b0-a3fa872729e7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098725 Aug 31 12:25:16.073738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 455/936] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:16.075784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:16.076645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:16.077431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:16.078703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:16.079595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:16.080336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:16.143009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6ceeaaa0-4d4b-4d5a-97fa-4b842ad95461 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091069 Aug 31 12:25:16.144038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 482/937] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:16.287268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:16.291083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:16.302325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:16.303139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:16.303936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:16.305230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:16.306131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:16.307044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:16.353108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-266c36b8-376f-489c-a041-70064c4a2dd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073274 Aug 31 12:25:16.353971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 456/938] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:17.087974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:17.090695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:17.099263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:17.099903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:17.100380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:17.109867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:17.109867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:17.109867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:17.150559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4394ab47-d2d5-4ef7-bf8c-5711d3d9d9dc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067668 Aug 31 12:25:17.151738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 483/939] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:17.163521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:17.167613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:17.180349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:17.181430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:17.182277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:17.183632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:17.184445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:17.185162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:17.226765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b1ff8a35-0a31-4d9d-b040-72b39e283ebf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071259 Aug 31 12:25:17.227612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 457/940] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:17.372985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:17.376560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:17.388758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:17.389615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:17.390424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:17.391804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:17.392673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:17.393457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:17.443077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a22a990-e94f-4dd6-80ba-0620eec89929 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079493 Aug 31 12:25:17.443733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 484/941] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:18.164467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:18.167140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:18.176076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:18.176589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:18.177035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:18.177883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:18.178384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:18.179006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:18.224342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7674be8-17d7-474a-b9ee-44861cb573c5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064593 Aug 31 12:25:18.225150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 458/942] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:18.251077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:18.254927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:18.265931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:18.266663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:18.267368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:18.268500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:18.269206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:18.269852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:18.321452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c850d05-2864-45c3-a443-0631007ee465 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076659 Aug 31 12:25:18.322474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 485/943] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:18.461439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:18.465341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:18.477517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:18.478360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:18.479092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:18.480357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:18.481006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:18.481541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:18.506859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:18.535275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08855733-4e5c-4f71-8abc-d3b6cd4f9ca7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081411 Aug 31 12:25:18.536370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 459/944] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:19.237926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:19.240465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:19.248323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:19.248972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:19.249518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:19.250449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:19.251060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:19.251648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:19.290122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75c2fbe3-f486-414c-8eac-513e4a9d8173 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056356 Aug 31 12:25:19.290757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 486/945] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:19.341569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:19.345511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:19.357566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:19.358441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:19.359286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:19.360535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:19.361354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:19.362099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:19.430542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a5f1eb5b-01a6-48a9-a730-f6a9c0c2ff7d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096457 Aug 31 12:25:19.431608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 460/946] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:19.558976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:19.562939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:19.574679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:19.575596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:19.576422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:19.577681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:19.578516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:19.579224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:19.649045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ad28085-ed2d-40a4-add7-b0505453e59b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098179 Aug 31 12:25:19.650059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 487/947] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:20.306283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:20.308849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:20.316512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:20.317063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:20.317548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:20.318331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:20.318831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:20.319352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:20.356828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dfae4ee1-0576-4f3b-9ed8-cccede16b3d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054671 Aug 31 12:25:20.357911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 461/948] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:20.447666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:20.450085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:20.459754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:20.460274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:20.460712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:20.461455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:20.461909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:20.462330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:20.500706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b43d5c0b-ed71-4441-a60d-a3d6e21f46c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057126 Aug 31 12:25:20.501406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 488/949] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:20.670441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:20.674222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:20.685785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:20.686633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:20.687474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:20.688727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:20.689545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:20.690238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:20.757379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a3cca9e-6789-4385-8067-a499569a1980 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094213 Aug 31 12:25:20.758347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 462/950] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:21.378019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:21.381885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:21.393299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:21.394133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:21.394904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:21.396285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:21.397193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:21.397986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:21.463055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a67a2bb-04f0-413c-bd30-13bdff8edda6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093593 Aug 31 12:25:21.464103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 489/951] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:21.519097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:21.522550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:21.532823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:21.533751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:21.534336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:21.535502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:21.536291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:21.537321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:21.599282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9738113c-58fb-4eb1-ab57-14d1ee33a036 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087579 Aug 31 12:25:21.600375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 463/952] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:21.775952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:21.778390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:21.785754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:21.786309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:21.787168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:21.788095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:21.788680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:21.789194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:21.830528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d57f96d2-7340-4952-83df-10f463d10a02 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059163 Aug 31 12:25:21.831279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 490/953] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:22.484415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:22.488342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:22.499928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:22.500816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:22.501585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:22.502858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:22.503700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:22.504471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:22.566320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-965d653a-6e41-4f4a-aba7-cdd4cc733031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089283 Aug 31 12:25:22.567388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 464/954] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:22.619045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:22.623092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:22.635725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:22.636536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:22.637267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:22.638461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:22.639290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:22.640034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:22.686763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-31ec6c4d-988d-4893-b490-638f70d203f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074743 Aug 31 12:25:22.687484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 491/955] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:22.844392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:22.846663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:22.853703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:22.854200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:22.854646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:22.855413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:22.855877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:22.856307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:22.899400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25bc97a9-6c97-493c-bb1c-6593b1d619c4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059564 Aug 31 12:25:22.900171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 465/956] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:23.589357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:23.592720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:23.603788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:23.604650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:23.605419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:23.606703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:23.607536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:23.608281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:23.660015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-84844980-73e3-48c2-9d0a-0aceb4023f77 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077905 Aug 31 12:25:23.661128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 492/957] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:23.707045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:23.711143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:23.723424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:23.724326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:23.725113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:23.726388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:23.727275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:23.728047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:23.789614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-af28bd32-d4ae-407b-ab4b-cd83a2c1ac89 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089996 Aug 31 12:25:23.790565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 466/958] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:23.918159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:23.921736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:23.933662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:23.934472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:23.935285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:23.936693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:23.937403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:23.938310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:23.998507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-db7c4812-29eb-42fe-8b24-b4da8f01f1a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087738 Aug 31 12:25:23.999785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 493/959] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:24.674955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:24.678309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:24.686193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:24.686768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:24.687172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:24.687940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:24.688386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:24.688803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:24.742015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7c78969-6803-4bf1-8e6e-a388979afa4b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071331 Aug 31 12:25:24.742939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 467/960] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:24.810945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:24.814921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:24.828260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:24.829173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:24.829952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:24.831272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:24.832126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:24.832880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:24.874971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-082117f4-562c-4580-9303-4cd64040a9df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071846 Aug 31 12:25:24.875856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 494/961] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:25.019225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:25.022526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:25.031138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:25.031656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:25.032093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:25.032821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:25.033273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:25.033692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:25.088266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c966b7e-2d6b-449d-b6d8-5c1014f1ca3d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075561 Aug 31 12:25:25.089233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 468/962] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:25.757451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:25.760816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:25.770799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:25.771707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:25.772493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:25.773774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:25.774614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:25.775480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:25.836168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b48b1cfb-58d0-4e26-991b-211ef21129ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082922 Aug 31 12:25:25.837315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 495/963] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:25.890072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:25.892646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:25.900608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:25.901139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:25.901608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:25.902363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:25.902848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:25.903347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:25.943862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-466b97d3-66b4-4412-815e-7cc5fab88301 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058556 Aug 31 12:25:25.944528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 469/964] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:26.106632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:26.110085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:26.122031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:26.122868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:26.123966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:26.125106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:26.125880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:26.126604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:26.177669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:26.186183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4029936-687f-4e0c-9aa1-d36ea25c29cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086835 Aug 31 12:25:26.186945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 496/965] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:26.853030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:26.855612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:26.863514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:26.864108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:26.864541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:26.865273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:26.865725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:26.866220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:26.907746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9962b7e1-c77b-4693-871b-5dd0ffe7f238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058218 Aug 31 12:25:26.908796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 470/966] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:26.961614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:26.965641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:26.977822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:26.978706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:26.979779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:26.981076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:26.981913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:26.982697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:27.044125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-698db1c9-18d7-43ba-9bd4-96b8f17e93f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090053 Aug 31 12:25:27.045024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 497/967] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:27.200785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:27.203168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:27.211605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:27.212544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:27.213691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:27.214560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:27.215409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:27.216177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:27.272736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b8597f1-454d-4654-bbaf-97842fd48ae2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076617 Aug 31 12:25:27.273723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 471/968] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:27.923561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:27.926422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:27.934305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:27.935438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:27.936043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:27.936875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:27.937448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:27.937997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:27.985353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66acbaf2-8ae8-403d-a54a-c27d8f58c7fe tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066785 Aug 31 12:25:27.986472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 498/969] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:28.062910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:28.066838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:28.070155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=84 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:28.076460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:28.076958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:28.077391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:28.078143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:28.078658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:28.079373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:28.118999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-75cf599e-7b6f-459e-8746-b7bcc727a899 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063685 Aug 31 12:25:28.119672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 472/970] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:28.293090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:28.296748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:28.308012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:28.308843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:28.309603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:28.310810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:28.311600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:28.312315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:28.357813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-be823dbc-5582-45fa-a76f-3158436e40af tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072101 Aug 31 12:25:28.358409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 499/971] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:29.003717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:29.007560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:29.019179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:29.020074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:29.020830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:29.022104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:29.022939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:29.023744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:29.087523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-021dfc35-d9b7-4e15-b4cf-08a3dd7c8d5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090979 Aug 31 12:25:29.088642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 473/972] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:29.139871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:29.143621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:29.158541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:29.159440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:29.159974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:29.160918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:29.161987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:29.162747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:29.214130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26409ef3-ddd0-4e31-9ee1-25e7dc812617 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081914 Aug 31 12:25:29.214871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 500/973] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:29.380967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:29.385003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:29.397381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:29.398319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:29.399536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:29.400805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:29.401702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:29.402378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:29.474429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e77c2f4-0088-4731-96ee-ec582f1ddf6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103290 Aug 31 12:25:29.475508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 474/974] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:30.116235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:30.121036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:30.135056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:30.136422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:30.137147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:30.138614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:30.139552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:30.140833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:30.229536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff34fe23-368f-40d8-9ab5-70c9d6985692 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128388 Aug 31 12:25:30.230672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 501/975] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:30.239266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:30.242251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:30.252475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:30.253026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:30.253507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:30.254278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:30.254869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:30.255449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:30.301946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-59e0e728-cb0b-43da-a5b3-37638332ffdb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069236 Aug 31 12:25:30.302883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 475/976] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:30.495977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:30.498436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:30.508819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:30.510398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:30.511215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:30.512496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:30.513338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:30.514083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:30.575191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad190209-e688-4719-ba0f-6cdd5b86841c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085932 Aug 31 12:25:30.576191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 502/977] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:31.251426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:31.255161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:31.267893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:31.268749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:31.269492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:31.270710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:31.271428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:31.272111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:31.277551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:31.322980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:31.326547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:31.336908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c6d77cfa-c59d-4a75-8059-855d6432eb5f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092815 Aug 31 12:25:31.338467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 476/978] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:31.338684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:31.338980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:31.339819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:31.341076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:31.341873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:31.342324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:31.402813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3cbe1044-d447-4dab-85ad-bfabad23f711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086956 Aug 31 12:25:31.403766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 503/979] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:31.592971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:31.596792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:31.606304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:31.606946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:31.607427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:31.608175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:31.608638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:31.609214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:31.664977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2169812-c573-446b-bf28-e37cc0f4fe0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078785 Aug 31 12:25:31.665925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 477/980] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:32.355139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:32.358142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:32.366560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:32.367153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:32.367773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:32.368744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:32.369842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:32.370370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:32.420390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-720b4f52-13ca-4793-9df9-085e1d550b9d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070398 Aug 31 12:25:32.421180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 504/981] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:32.421687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:32.424710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:32.434728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:32.435426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:32.435982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:32.436811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:32.437478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:32.438001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:32.478277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4986fcc0-6c4d-450b-80e3-981ec7a1f892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061777 Aug 31 12:25:32.479340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 478/982] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:32.680221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:32.682570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:32.689642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:32.690135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:32.690587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:32.691349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:32.691852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:32.692281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:32.727748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1960d3fb-0278-4d03-866d-4f8a49124cf1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051984 Aug 31 12:25:32.728659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 505/983] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:33.435132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:33.439542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:33.451464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:33.452470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:33.453402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:33.454558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:33.455465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:33.456250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:33.492241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:33.496162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:33.498494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:25:33.498692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:25:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments (ip 10.222.0.27) !!! Aug 31 12:25:33.510930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:33.521510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:33.521510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:33.522763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:33.524417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:33.524954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:33.527761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-46531ea9-657f-46af-894a-cc613b21a832 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096993 Aug 31 12:25:33.529206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 479/984] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:33.570495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-631911e0-408c-4d21-896a-28e62b350446 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083163 Aug 31 12:25:33.571192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 506/985] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:33.743773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:33.746137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:33.754652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:33.755200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:33.755767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:33.756662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:33.757214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:33.757698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:33.804737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0dc2e2a4-9f90-485d-8a81-87032d4b12fb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065252 Aug 31 12:25:33.805923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 480/986] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:34.548163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:34.550506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:34.558256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:34.558903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:34.559479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:34.560241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:34.560735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:34.561214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:34.584728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:34.588132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:34.596754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:34.597473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:34.598132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:34.599075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:34.599768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:34.600322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:34.618780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a1d06b2-09ba-40fb-9909-2a7a476aa360 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075298 Aug 31 12:25:34.619829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 507/987] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:34.644065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-36cf26b9-bb60-4c71-ad32-a8e8fc83d1d6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062815 Aug 31 12:25:34.645228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 481/988] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:34.825048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:34.829054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:34.841116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:34.841969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:34.842721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:34.844097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:34.844910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:34.845652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:34.904790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73369410-c211-47a5-a475-f8d88c476744 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088385 Aug 31 12:25:34.905802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 508/989] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:35.639424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:35.643885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:35.657673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:35.658467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:35.659164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:35.660515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:35.661773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:35.662456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:35.665953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:35.669987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:35.687856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:35.688728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:35.689487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:35.690735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:35.691614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:35.692394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:35.714768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8229d8e-ac9e-4de9-84f4-3305c569788b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083382 Aug 31 12:25:35.715717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 482/990] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:35.765069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbd47328-8eb4-4b8c-b645-3de7292edee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106622 Aug 31 12:25:35.766001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 509/991] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:35.922296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:35.926113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:35.936226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:35.936808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:35.937299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:35.938127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:35.938625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:35.939097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:35.997837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3c27b131-ff72-4f11-bf70-beed6edec515 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079668 Aug 31 12:25:35.998924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 483/992] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:36.730479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:36.733376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:36.742003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:36.742556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:36.743034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:36.744167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:36.744846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:36.745379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:36.784942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:36.789325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:36.802666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22417055-aeed-4c68-a105-82621377a2b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077007 Aug 31 12:25:36.803559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:36.804951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 510/993] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:36.805185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:36.805185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:36.808210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:36.809240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:36.810055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:36.876570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-534dd338-f939-4c4e-8be5-6138d62b86cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099172 Aug 31 12:25:36.877655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 484/994] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:37.014411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:37.016929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:37.024141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:37.024859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:37.025370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:37.026444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:37.026959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:37.027461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:37.067709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1ae5d591-89fc-44f4-8a0b-bb59150dbf61 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057502 Aug 31 12:25:37.068493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 511/995] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:37.820376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:37.828331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:37.831165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:37.831837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:37.832421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:37.833281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:37.833861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:37.834411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:37.878299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1ce86fad-ccf0-4937-b532-1dea3e58c47f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062792 Aug 31 12:25:37.882425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 485/996] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:37.896336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:37.900598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:37.914064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:37.915304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:37.915912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:37.917169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:37.917937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:37.918689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:37.962943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9f902fc-9d90-4b5d-9583-d21a07c6c981 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073087 Aug 31 12:25:37.967789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 512/997] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:38.088082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:38.092182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:38.103843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:38.104645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:38.105332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:38.106636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:38.107485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:38.108326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:38.170630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bf6c342c-42f0-492f-a349-59c5fd0c5670 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090631 Aug 31 12:25:38.171712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 486/998] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:38.899670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:38.904294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:38.918780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:38.919668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:38.920413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:38.921935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:38.922786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:38.923742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:38.953522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:38.980403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:38.985509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:38.989557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-555481c6-a289-48c1-868c-3ea766cc6980 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097603 Aug 31 12:25:38.990586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 513/999] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:38.997596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:38.998430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:38.999195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:39.000486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:39.001271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:39.002032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:39.067022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-46f39cb3-9065-4163-be83-f67395338e3a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093354 Aug 31 12:25:39.068060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 487/1000] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:39.191900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:39.195978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:39.208193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:39.208891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:39.209593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:39.210818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:39.211887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:39.213363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:39.278732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1eb24ca6-b44a-4ca1-876c-f57630990d03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094244 Aug 31 12:25:39.279356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 514/1001] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:40.007503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:40.010329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:40.018436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:40.019145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:40.019910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:40.021059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:40.021830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:40.022612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:40.069582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e00d8263-b4c7-42f0-b8b5-cc2443d41ae0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066965 Aug 31 12:25:40.070177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 488/1002] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:40.083939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:40.086542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:40.094391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:40.094875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:40.095347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:40.096054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:40.096509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:40.096915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:40.131340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7fdbe7bb-76b1-4dfc-aaa7-5086281f8dce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051862 Aug 31 12:25:40.131934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 515/1003] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:40.294813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:40.297174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:40.304130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:40.304671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:40.305141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:40.305983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:40.306541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:40.307104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:40.363259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd556772-e2e7-4f60-abe7-61279569e369 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072119 Aug 31 12:25:40.364369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 489/1004] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:41.088370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:41.092210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:41.096270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=84 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:41.106124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:41.106971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:41.107772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:41.109005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:41.109791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:41.110505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:41.146011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:41.149381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:41.157656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:41.158592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:41.159198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:41.160230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:41.160872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:41.161612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:41.170938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf532656-be1f-4f2a-a24c-04da08ef3b43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089780 Aug 31 12:25:41.171997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 516/1005] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:41.198648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-636ad3cb-a317-4620-be86-3b83363be01e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057523 Aug 31 12:25:41.199461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 490/1006] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:41.378940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:41.381134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:41.389043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:41.389567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:41.389987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:41.390736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:41.391193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:41.391637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:41.430018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c09c210c-117e-43bd-8fb5-607744b38a43 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055213 Aug 31 12:25:41.431192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 517/1007] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:42.189586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:42.192516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:42.201375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:42.201915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:42.202386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:42.203166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:42.203763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:42.204264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:42.217389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:42.221190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:42.233610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:42.234472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:42.235208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:42.236498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:42.237308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:42.238059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:42.247138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b5dadc80-c020-4978-98dc-1c53d6b745b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063129 Aug 31 12:25:42.248147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 491/1008] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:42.297183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e269a7cd-6cab-413d-aed2-3203fe9faa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086946 Aug 31 12:25:42.298226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 518/1009] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:42.444155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:42.448147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:42.454997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:42.455538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:42.456051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:42.456802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:42.457261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:42.457718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:42.488780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:42.500633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d1ce781-ceee-45b2-b9d2-52e4390b5a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060515 Aug 31 12:25:42.501629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 492/1010] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:43.261817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:43.264527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:43.272560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:43.273202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:43.273733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:43.274782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:43.275527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:43.276067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:43.317634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:43.318944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3e2407d1-0b7f-48af-abad-8ad35bbb1727 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061361 Aug 31 12:25:43.319945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 519/1011] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:43.321051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:43.329185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:43.329812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:43.330550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:43.331842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:43.332648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:43.333377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:43.374681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0184899-34a0-41f2-a103-19cc6e428e31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064423 Aug 31 12:25:43.375389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 493/1012] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:43.518697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:43.522627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:43.536807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:43.537728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:43.538265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:43.539050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:43.539586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:43.540289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:43.585468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-314042cd-f795-439f-8b9b-879cc69aa5a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072150 Aug 31 12:25:43.586329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 520/1013] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:44.338942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:44.342612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:44.354967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:44.355860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:44.356628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:44.357892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:44.358699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:44.359505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:44.393272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:44.397453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:44.411775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:44.413505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:44.413505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:44.415175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:44.416352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:44.417108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:44.422892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fd2aac3f-57f2-4216-bfa1-8086f7be8404 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091351 Aug 31 12:25:44.424174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 494/1014] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:44.473034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3eefaeb6-0b55-479f-a2ed-0c83abdd8b8f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087748 Aug 31 12:25:44.473916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 521/1015] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:44.606523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:44.610226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:44.617436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:44.618058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:44.618725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:44.619869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:44.620327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:44.620764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:44.659457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa0ceef9-e01b-457a-a6fb-0f260e698fb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060059 Aug 31 12:25:44.660157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 495/1016] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:45.440486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:45.442804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:45.450657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:45.451155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:45.451628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:45.452628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:45.453094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:45.453525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:45.491443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:45.492519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9412d77d-69b1-4a3a-9c5b-caa2ace3be47 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056433 Aug 31 12:25:45.494247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 522/1017] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:45.495344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:45.506825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:45.507773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:45.508574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:45.509827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:45.510627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:45.511423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:45.570332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4a82cd7-d970-477b-b942-6f28f13acd8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086300 Aug 31 12:25:45.571682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 496/1018] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:45.676770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:45.681052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:45.691739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:45.692490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:45.693372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:45.694504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:45.695311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:45.696104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:45.746098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-209fc775-37d2-49f2-bf57-ebd010dd2a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076265 Aug 31 12:25:45.746779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 523/1019] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:46.506868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:46.510078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:46.519692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:46.519854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:46.520281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:46.521345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:46.522027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:46.522586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:46.567365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ed62a5d-cf77-4178-a034-3d43a150c573 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064960 Aug 31 12:25:46.567971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 497/1020] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:46.584312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:46.586830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:46.594918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:46.595519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:46.596064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:46.596901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:46.597429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:46.597940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:46.636171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aa9f3000-a682-4063-80d3-f1f317cc17ed tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056024 Aug 31 12:25:46.637006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 524/1021] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:46.760630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:46.763112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:46.774121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:46.775003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:46.776054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:46.777347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:46.778187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:46.778906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:46.838538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-504800b8-bc64-4353-a909-4d5f3b8b63f4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083247 Aug 31 12:25:46.839605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 498/1022] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:47.585074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:47.588985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:47.600729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:47.601562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:47.602213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:47.603275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:47.603961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:47.604719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:47.655140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:47.656914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e87b3f30-8f3d-4361-bdcc-a5445f3172de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079778 Aug 31 12:25:47.657616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 525/1023] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:47.658914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:47.672020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:47.672911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:47.673641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:47.674950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:47.675784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:47.676534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:47.734764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f16313c-b3a7-4295-93dc-0de509736fe7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087814 Aug 31 12:25:47.735845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 499/1024] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:47.853191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:47.855372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:47.862245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:47.862906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:47.863383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:47.864121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:47.864581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:47.865007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:47.910562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d45d8df3-5f95-481c-a575-359a228b3902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061490 Aug 31 12:25:47.911587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 526/1025] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:48.674694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:48.678328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:48.690381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:48.691216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:48.692154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:48.693198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:48.694088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:48.694746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:48.741733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6699cac9-ce24-4256-9e48-f760157699c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074530 Aug 31 12:25:48.742833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 500/1026] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:48.755723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:48.759812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:48.772930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:48.773885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:48.774798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:48.776185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:48.777050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:48.777845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:48.829430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e3ab86da-ce6d-45ba-b9ba-197ccd9b3a39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081621 Aug 31 12:25:48.830183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 527/1027] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:48.924230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:48.927202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:48.934043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:48.934660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:48.935163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:48.935952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:48.936524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:48.937063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:48.974943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e28590f-df06-48e1-be84-ce42d749ee45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054948 Aug 31 12:25:48.975577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 501/1028] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:49.756905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:49.760016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:49.767589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:49.768119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:49.768608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:49.769364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:49.769858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:49.770320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:49.807811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1633cdb0-5357-4029-881b-b37a98e53106 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055218 Aug 31 12:25:49.808408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 528/1029] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:49.843534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:49.846376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:49.855649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:49.856354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:49.857051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:49.858073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:49.858732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:49.859388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:49.897962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dcd1c043-fa89-4709-aa83-cc062f2f0b6c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058686 Aug 31 12:25:49.898974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 502/1030] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:49.989263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:49.991704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:49.999743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:50.000323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:50.000823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:50.001644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:50.002142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:50.002887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:50.040253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a05579c1-3058-4e5c-a42f-51746933d95a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055294 Aug 31 12:25:50.040992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 529/1031] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:50.820559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:50.823226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:50.830293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:50.830841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:50.831352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:50.832262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:50.832769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:50.833262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:50.869634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d476d2fd-063c-4ecf-ac59-060cc98bdac8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053068 Aug 31 12:25:50.870467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 503/1032] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:50.911205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:50.914065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:50.922439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:50.923062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:50.923722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:50.924535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:50.925170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:50.925715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:50.928877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:50.986114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ebbc6b8f-8a5e-4d88-85ff-e829030c3700 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079161 Aug 31 12:25:50.987139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 530/1033] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:51.054377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:51.056777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:51.063412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:51.063900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:51.064328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:51.065030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:51.065481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:51.065887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:51.104094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f50f92ca-1b49-4cc7-b53c-3619a1dcfe4c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053833 Aug 31 12:25:51.104717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 504/1034] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:51.885576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:51.888978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:51.897925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:51.898594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:51.900334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:51.900753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:51.901491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:51.902261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:51.950899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6bcb5f3e-ed57-4666-8ead-64aed4b60df9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071149 Aug 31 12:25:51.951932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 531/1035] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:52.000534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:52.002779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:52.010913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:52.011451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:52.011870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:52.012658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:52.013085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:52.013504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:52.049917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b3b1e5d-b079-4d42-a0e6-7f6dd68c1c97 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053467 Aug 31 12:25:52.050512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 505/1036] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:52.117953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:52.120592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:52.127688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:52.128322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:52.128869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:52.129736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:52.130308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:52.130905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:52.185184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e68f0d4-0a90-4ca4-ae88-c1817a78add7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071830 Aug 31 12:25:52.186157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 532/1037] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:52.967783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:52.971262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:52.983342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:52.984312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:52.985145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:52.986431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:52.987277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:52.988017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:53.050506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb88a674-5412-4e00-b685-4de04b58d301 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087218 Aug 31 12:25:53.051876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 506/1038] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:53.064076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:53.066407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:53.076988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:53.077885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:53.078728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:53.080144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:53.081017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:53.081808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:53.140585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b5cfa9a-bdf1-4186-bee3-6f527b1eac3c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081073 Aug 31 12:25:53.141609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 533/1039] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:53.199130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:53.201460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:53.208993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:53.209485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:53.209897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:53.210604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:53.211055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:53.211954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:53.252134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6c420bb9-7d18-4f7c-84a2-484de08bb00e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057093 Aug 31 12:25:53.253223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 507/1040] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:54.068885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:54.073849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:54.085674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:54.086599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:54.087425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:54.088708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:54.089552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:54.090310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:54.127750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff8dc5e6-ff55-483a-bf46-0f215b3ac214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065939 Aug 31 12:25:54.128379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 534/1041] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:54.154699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:54.157112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:54.165484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:54.166040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:54.166535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:54.167491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:54.168007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:54.168480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:54.206685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-df4b4e60-7f0a-4022-94ad-2ab26121e4e3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056123 Aug 31 12:25:54.207425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 508/1042] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:54.268919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:54.271178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:54.278878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:54.279511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:54.280054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:54.280914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:54.281422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:54.281901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:54.317936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad19e8ca-b126-4c27-a08b-aa51f3fd8414 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053273 Aug 31 12:25:54.318637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 535/1043] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:55.143380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:55.145558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:55.152847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:55.153355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:55.153805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:55.154536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:55.155000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:55.155810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:55.174079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:55.193249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef04ceb8-76f1-4df3-8f9d-796e5113f506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056075 Aug 31 12:25:55.193815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 509/1044] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:55.219848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:55.222155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:55.230524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:55.231070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:55.231589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:55.232348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:55.232838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:55.233298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:55.268912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d12ae40-a1c3-4bdf-b761-c8f9bb675600 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053149 Aug 31 12:25:55.269504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 536/1045] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:55.330773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:55.333034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:55.340012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:55.340508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:55.340945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:55.341661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:55.342113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:55.342534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:55.377665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b11fd7c-5050-4e01-9d2d-eecebc0b1c09 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050960 Aug 31 12:25:55.378165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 510/1046] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:56.212286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:56.216192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:56.232076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:56.232922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:56.233661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:56.234839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:56.235702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:56.236479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:56.274558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fdafa544-8411-4de1-bd40-ca0165664a10 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070597 Aug 31 12:25:56.275208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 537/1047] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:56.286510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:56.291076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:56.303603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:56.304434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:56.305266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:56.307329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:56.308130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:56.308895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:56.370688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5850c73e-2bca-40fa-8220-bba5e169eba4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091524 Aug 31 12:25:56.371707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 511/1048] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:56.391126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:56.393442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:56.400572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:56.401309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:56.401759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:56.402704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:56.403266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:56.403753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:56.440807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3378842a-e52f-4f5b-b8b5-93efeea76497 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054194 Aug 31 12:25:56.441392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 538/1049] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:25:57.288376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:57.291048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:57.298573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:57.299059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:57.299527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:57.300246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:57.300698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:57.301118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:57.342400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0bd38185-3dbe-4bc2-8d19-0d449e8a3ebf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058340 Aug 31 12:25:57.343463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 512/1050] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:57.392444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:57.396365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:57.409384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:57.410457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:57.411579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:57.413116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:57.414228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:57.415030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:57.455464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:57.457938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:57.465663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:57.466153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:57.466616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:57.467397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:57.467852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:57.468286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:57.478816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-453e0d60-db92-456c-a20a-c00964396097 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093634 Aug 31 12:25:57.480402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 539/1051] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:57.527604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-94d4db52-e87d-44cc-a17c-7caef4827f5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077029 Aug 31 12:25:57.528649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 513/1052] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:58.360032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:58.362367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:58.370160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:58.370756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:58.371276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:58.372067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:58.372632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:58.373171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:58.421303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f4ed930e-c7c3-4758-8a5b-ad806bf34c29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065269 Aug 31 12:25:58.422369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 540/1053] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:58.495049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:58.497478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:58.500662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=84 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:58.507964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:58.508742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:58.509301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:58.510168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:58.510724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:58.511430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:58.548348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:58.553278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:58.561432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eefdb57c-23ab-4440-96a0-9f7eff04e747 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069849 Aug 31 12:25:58.562405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 514/1054] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:58.566837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:58.567759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:58.569105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:58.569733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:58.570256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:58.570767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:58.610807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3d42b04c-4273-4b20-98cf-69db5589b69d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069529 Aug 31 12:25:58.611610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 541/1055] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:25:59.440383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:59.444087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:59.454433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:59.455221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:59.455957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:59.457116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:59.457816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:59.458492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:59.527152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-391f00a3-196c-44fa-bdee-e74318cabb68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094635 Aug 31 12:25:59.528296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 515/1056] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:25:59.580265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:59.583913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:59.596956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:59.597893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:59.598742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:59.600069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:59.600981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:59.602384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:59.631758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:25:59.634260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:25:59.642092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:59.642689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:59.643181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:59.644121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:25:59.644699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:25:59.645245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:25:59.657321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-136d2ace-9e65-4104-97f0-ff094d2b220d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082790 Aug 31 12:25:59.658354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 542/1057] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:25:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:25:59.691069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c24cf1a5-1d1b-4f60-9192-911956614f40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064012 Aug 31 12:25:59.691882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 516/1058] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:25:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:00.547835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:00.551651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:00.560854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:00.561356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:00.561789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:00.562520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:00.562967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:00.563448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:00.606138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73ff968d-6936-4f16-aed6-5237530a13af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065668 Aug 31 12:26:00.607271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 543/1059] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:00.677811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:00.681897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:00.693704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:00.694490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:00.695187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:00.696430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:00.697138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:00.697846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:00.704868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:00.707115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:00.714912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:00.715448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:00.716053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:00.716953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:00.717414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:00.717835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:00.755057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-be1af75e-c74b-4e5b-b714-7a7d9a6a03d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054158 Aug 31 12:26:00.755800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 544/1060] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:00.757775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ce8c8ee9-1f22-4d64-abc4-db0b800edf30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086818 Aug 31 12:26:00.758961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 517/1061] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:01.625343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:01.629147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:01.640125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:01.640973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:01.641691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:01.642909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:01.646954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:01.646954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:01.684142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a91de11f-830d-4d46-b280-ec8c358bb587 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067787 Aug 31 12:26:01.684732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 545/1062] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:01.770484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:01.773412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:01.778580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:01.781802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:01.782300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:01.782490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:01.782842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:01.783864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:01.784601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:01.785183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:01.793959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:01.794803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:01.795615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:01.796896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:01.797646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:01.798442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:01.830482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-723af331-6ea1-4d7c-96fc-bc004cfd4714 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064904 Aug 31 12:26:01.831776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 518/1063] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:01.838353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:01.847371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd7b8a25-fa8c-4b17-8266-50ef03052cfa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076477 Aug 31 12:26:01.848120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 546/1064] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:02.701386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:02.705251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:02.717097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:02.717802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:02.718618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:02.719965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:02.720812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:02.721499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:02.797354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b8afeb3-88f4-40ee-9cd9-39d44c301171 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103332 Aug 31 12:26:02.798276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 519/1065] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:02.851137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:02.855032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:02.861755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:02.865609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:02.866918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:02.867922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:02.868631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:02.869741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:02.870375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:02.871056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:02.877431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:02.878074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:02.878797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:02.880202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:02.881028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:02.881769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:02.912899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cb40e973-3064-404a-a9bb-61fd9ba21a20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069359 Aug 31 12:26:02.913494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 547/1066] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:02.944897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9164ce75-8906-4754-96af-854e7eb3b8de tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087638 Aug 31 12:26:02.946152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 520/1067] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:03.815344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:03.819103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:03.830101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:03.830923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:03.831682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:03.832903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:03.833705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:03.834435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:03.885769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8ff5375f-4740-4c1a-83ae-bd6890f23dd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078109 Aug 31 12:26:03.886788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 548/1068] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:03.926710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:03.929376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:03.937770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:03.938262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:03.938700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:03.939494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:03.939954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:03.940380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:03.960464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:03.964802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:03.974193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:03.974837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:03.975447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:03.976695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:03.977116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:03.977858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:03.980831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e3593649-d873-4533-89bc-934466666e2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058506 Aug 31 12:26:03.981444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 521/1069] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:04.015678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb0c36e0-e5cc-455c-adf0-6e3ff0d8f2ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060339 Aug 31 12:26:04.016387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 549/1070] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:04.905800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:04.909680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:04.921621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:04.922459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:04.923217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:04.924546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:04.925391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:04.926105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:04.965642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-47512a1f-cc47-4458-a01f-0579134b556d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067184 Aug 31 12:26:04.966581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 522/1071] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:04.995550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:04.998061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:05.006484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:05.007174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:05.007892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:05.008744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:05.009301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:05.009823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:05.029756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:05.032233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:05.043837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:05.044885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:05.045461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:05.046614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:05.047399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:05.048098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:05.054987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e97353a5-355c-4d95-b25b-67a8e3a2899e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063938 Aug 31 12:26:05.055800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 550/1072] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:05.087155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26d2c6ad-fc67-4ab2-b92a-c507fce480a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061748 Aug 31 12:26:05.088011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 523/1073] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:05.979352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:05.982201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:05.989843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:05.990387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:05.990909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:05.991879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:05.993123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:05.993781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:06.032223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82c61863-d914-4535-885c-3d8e03747e51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057081 Aug 31 12:26:06.033321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 551/1074] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:06.077501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:06.081228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:06.091568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:06.092356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:06.093082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:06.094301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:06.095273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:06.095971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:06.100914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:06.105549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:06.113065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:06.113726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:06.114300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:06.115139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:06.115903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:06.116590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:06.146856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac513ca1-cdd6-42ef-afc4-8cf00bde1ca5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079088 Aug 31 12:26:06.147630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 524/1075] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:06.167669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a43b7e78-bf04-4e62-ac40-2165c74de8fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071069 Aug 31 12:26:06.168299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 552/1076] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:07.046565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:07.049053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:07.056366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:07.056916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:07.057388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:07.058315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:07.058882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:07.059382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:07.096958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac202ebb-a1ce-4a4f-8ff8-b65135ac0786 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054450 Aug 31 12:26:07.098053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 525/1077] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:07.164619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:07.167409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:07.180980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:07.181862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:07.182606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:07.183824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:07.184531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:07.185221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:07.187560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:07.191989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:07.203135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:07.204059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:07.204811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:07.206124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:07.206958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:07.207754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:07.215502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:07.229609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-87296bb4-9073-453e-a320-8d4e7f19d748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069806 Aug 31 12:26:07.230414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 553/1078] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:07.270032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f21d201f-f8a6-4756-8185-db455ce65a92 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090529 Aug 31 12:26:07.271106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 526/1079] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:08.112576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:08.114819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:08.123098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:08.123793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:08.124228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:08.124944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:08.125387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:08.125806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:08.167856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f523df0e-e40b-4052-b6a0-b7d9bb4e85a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059315 Aug 31 12:26:08.168933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 554/1080] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:08.246874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:08.251186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:08.261377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:08.262174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:08.263093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:08.264119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:08.264852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:08.265578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:08.287992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:08.290384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:08.297827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:08.298310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:08.298742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:08.299492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:08.302573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:08.302573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:08.321103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2d363cf-6f40-4b83-9132-41fa2206e36f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080742 Aug 31 12:26:08.322090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 527/1081] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:08.340041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c8aca44-3f65-463a-8550-4e6c327505a8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057282 Aug 31 12:26:08.340644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 555/1082] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:09.185779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:09.189482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:09.197157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:09.197645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:09.198130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:09.198859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:09.199354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:09.199942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:09.241492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06732ebb-53ae-431a-9582-863f3c018606 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063391 Aug 31 12:26:09.242076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 528/1083] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:09.338740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:09.341508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:09.349997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:09.350680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:09.351646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:09.352463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:09.353056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:09.353577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:09.354687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:09.358304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:09.368450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:09.369078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:09.369547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:09.371139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:09.371139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:09.371427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:09.399857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c410598-f0bb-430b-a105-e61dda741fe9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065091 Aug 31 12:26:09.400555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 556/1084] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:09.417452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7383e31-c767-40b9-a1f6-631aba1f8819 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068750 Aug 31 12:26:09.418477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 529/1085] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:10.259448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:10.263289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:10.274758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:10.275805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:10.276597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:10.277846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:10.278631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:10.279449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:10.339614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-410b35a9-f1d8-4e3c-8759-4bf990fbcb41 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087353 Aug 31 12:26:10.340658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 557/1086] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:10.415037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:10.417531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:10.435484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:10.436294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:10.437046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:10.437752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:10.438293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:10.439097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:10.439829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:10.440959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:10.452741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:10.453564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:10.454360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:10.455726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:10.456550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:10.457381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:10.492801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0862540d-58e9-459c-b185-6da6332b2a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082423 Aug 31 12:26:10.494967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 530/1087] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:10.526928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07dab704-f021-496c-a94f-504c48490f47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094871 Aug 31 12:26:10.528053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 558/1088] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:11.356230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:11.358497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:11.365479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:11.367419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:11.367419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:11.367785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:11.368483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:11.369240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:11.408664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7493cf9c-736f-48d0-86e2-359ee4979d81 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056767 Aug 31 12:26:11.409190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 531/1089] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:11.511253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:11.515138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:11.519639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=86 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:11.530839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:11.531774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:11.532572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:11.533852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:11.534665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:11.535766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:11.548236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:11.552204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:11.564853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:11.565623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:11.566398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:11.567732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:11.568544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:11.569396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:11.595335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b39a0c36-209f-4baa-9c11-f6940f4158d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091453 Aug 31 12:26:11.596360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 559/1090] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:11.631613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f517941-10a9-439f-99d8-943de979566f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090693 Aug 31 12:26:11.633432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 532/1091] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:12.422369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:12.424817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:12.433359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:12.434095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:12.434772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:12.435730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:12.436521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:12.437175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:12.478979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c883803-efae-4b84-8839-808d3575d3f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060318 Aug 31 12:26:12.480233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 560/1092] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:12.614933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:12.619185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:12.628158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:12.628659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:12.629109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:12.629847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:12.630325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:12.630751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:12.653567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:12.657394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:12.669471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:12.670639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:12.671390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:12.672668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:12.673347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:12.674023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:12.680815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0c7dee9-7dcb-488e-aec7-c4868c18b3f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072581 Aug 31 12:26:12.681866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 533/1093] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:12.725169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4126c52-8ec5-4d06-83af-d587a0f0e93a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078832 Aug 31 12:26:12.726311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 561/1094] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:13.495696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:13.498054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:13.505150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:13.505651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:13.506094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:13.506816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:13.507858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:13.508416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:13.553842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-faf790d0-a45e-4a6d-8196-add21c9d5d0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062927 Aug 31 12:26:13.557242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 534/1095] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:13.701219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:13.703880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:13.715168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:13.716054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:13.716826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:13.718083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:13.718911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:13.719798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:13.743321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:13.746974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:13.759336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:13.761184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:13.761184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:13.761940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:13.762726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:13.763478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:13.770218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73a87e17-922a-410a-8e81-e4a70c64a2c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075684 Aug 31 12:26:13.771022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 562/1096] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:13.806849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb01f5ce-0af6-4fa2-8257-44311840402f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070808 Aug 31 12:26:13.807720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 535/1097] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:14.575670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:14.579643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:14.591657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:14.592572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:14.593395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:14.594681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:14.595588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:14.596365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:14.624606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:14.657920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff5ed0cd-e29e-43e4-bdd9-3616ad748513 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090253 Aug 31 12:26:14.658920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 563/1098] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:14.791788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:14.795806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:14.809775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:14.810659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:14.811526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:14.812989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:14.813864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:14.814673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:14.826914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:14.831494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:14.854759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:14.855709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:14.856546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:14.857735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:14.858671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:14.859488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:14.876993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d00d1da2-4a0b-40b0-bbc8-4892c56bea89 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093637 Aug 31 12:26:14.878317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 536/1099] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:14.927631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91ffc51c-3d34-4db5-b911-4bdeeec30e95 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105302 Aug 31 12:26:14.927631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 564/1100] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:15.678905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:15.682736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:15.694532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:15.695776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:15.696613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:15.697908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:15.698735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:15.699519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:15.745670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1306dcba-827e-4f36-b929-d6631f97fc24 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074575 Aug 31 12:26:15.746267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 537/1101] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:15.894565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:15.898929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:15.909603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:15.910514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:15.911063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:15.912052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:15.912849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:15.913603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:15.942157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:15.945994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:15.957096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:15.957859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:15.958584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:15.960036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:15.960661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:15.961430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:15.967927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f35cedbd-ee01-4c12-9418-1def36f7e1c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077453 Aug 31 12:26:15.968977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 565/1102] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:16.021092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1c2dc61b-f9e3-4d7f-ac8d-1f12b9bee18b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085960 Aug 31 12:26:16.022058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 538/1103] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:16.765846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:16.769009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:16.776483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:16.777135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:16.777689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:16.778538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:16.779102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:16.779668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:16.819706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b17b1a4-be95-4b68-9edf-e8c45d53f6f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060338 Aug 31 12:26:16.820508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 566/1104] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:16.988531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:16.990996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:17.002646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:17.003552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:17.004366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:17.005704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:17.006514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:17.007486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:17.046315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:17.049696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:17.061941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:17.062771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:17.063582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:17.064868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:17.065740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:17.066447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:17.069389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b9205595-1d59-4bc0-832b-25c692855ef0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087650 Aug 31 12:26:17.071497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 539/1105] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:17.126033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-47ec0c75-a714-4d4f-aadf-9eb12ed698e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086287 Aug 31 12:26:17.126990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 567/1106] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:17.836779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:17.839747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:17.847117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:17.847800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:17.848287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:17.849109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:17.849739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:17.850257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:17.898463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55773f16-0b5c-4b3d-a0bd-f0a82b1c2cdf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065988 Aug 31 12:26:17.899309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 540/1107] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:18.087082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:18.089439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:18.097022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:18.097560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:18.098071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:18.098916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:18.099509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:18.099988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:18.139068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b6b3921-deb4-48cb-a3b0-14cc25da0357 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056288 Aug 31 12:26:18.139713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 568/1108] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:18.145445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:18.149333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:18.162034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:18.162907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:18.164056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:18.165381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:18.166187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:18.166929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:18.231920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0d468d56-7a3a-40f3-a4f2-12a4d30aa97f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091651 Aug 31 12:26:18.231920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 541/1109] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:18.915341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:18.917974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:18.926937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:18.927478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:18.927931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:18.929061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:18.929433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:18.930191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:18.968386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-806ae19a-7619-4ea4-82e2-80687e67de73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060098 Aug 31 12:26:18.969091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 569/1110] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:19.158940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:19.163196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:19.176140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:19.176925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:19.177719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:19.179056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:19.179974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:19.180809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:19.226251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:19.236926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7b7da1e-c74a-4f6a-9d70-a14d99093eb3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086197 Aug 31 12:26:19.238064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 542/1111] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:19.249927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:19.253978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:19.266513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:19.267452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:19.268243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:19.269551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:19.270411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:19.271192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:19.317635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf861310-56f5-4008-9812-fe35a710552c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074991 Aug 31 12:26:19.318290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 570/1112] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:19.984071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:19.986320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:19.993457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:19.993946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:19.994395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:19.995114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:19.995682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:19.996110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:20.047420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a2183028-a988-46d6-bc16-e5c0b5dc5754 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068422 Aug 31 12:26:20.048137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 543/1113] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:20.252879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:20.255283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:20.262432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:20.262916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:20.263358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:20.264098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:20.264535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:20.264958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:20.302133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85d757b8-4565-4ffb-8469-b2447b1f4a22 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053466 Aug 31 12:26:20.302715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 571/1114] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:20.331577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:20.334513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:20.343961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:20.344808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:20.345561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:20.346753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:20.347286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:20.347708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:20.407953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec27fe61-b0cb-4b81-b32b-f3bedf416959 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080145 Aug 31 12:26:20.409017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 544/1115] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:21.068239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:21.072047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:21.084055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:21.084374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:21.084890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:21.086171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:21.086955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:21.087753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:21.150099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-74a0012c-53cd-4ac8-bdb6-1d6534642b14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089118 Aug 31 12:26:21.151359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 572/1116] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:21.316579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:21.320180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:21.326915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:21.327449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:21.327882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:21.328585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:21.329032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:21.329479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:21.369191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77c3a066-23f3-45dd-aa0a-9a0ec5017e6b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056796 Aug 31 12:26:21.370280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 545/1117] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:21.424700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:21.427459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:21.435920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:21.436557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:21.437104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:21.438137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:21.438755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:21.439288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:21.479766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b247286-cfa8-402d-a133-c77950948c4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059087 Aug 31 12:26:21.480369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 573/1118] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:22.171017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:22.174801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:22.185020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:22.185814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:22.186523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:22.187764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:22.188729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:22.189479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:22.229007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24c102de-c4af-45cc-b3ad-41db1681cd6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065392 Aug 31 12:26:22.229587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 546/1119] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:22.383755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:22.386222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:22.393917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:22.394508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:22.395024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:22.395969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:22.396492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:22.396965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:22.439002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e5068c7c-64cd-43d0-8c70-3140df567a11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059836 Aug 31 12:26:22.440060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 574/1120] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:22.500002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:22.503791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:22.515994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:22.516784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:22.517523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:22.518765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:22.519589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:22.520308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:22.578278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d3f8f70-bbec-4944-a070-355900c0b9f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085292 Aug 31 12:26:22.579326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 547/1121] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:23.246149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:23.249908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:23.261073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:23.261901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:23.262643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:23.263955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:23.264744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:23.265474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:23.310742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-143d54c9-d50e-4322-a903-30660ff5a8b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072029 Aug 31 12:26:23.311878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 575/1122] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:23.454782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:23.457272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:23.467087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:23.467922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:23.468607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:23.469777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:23.470499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:23.471179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:23.510731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a7ee632-1040-4172-8e28-53fca80e13b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060634 Aug 31 12:26:23.511826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 548/1123] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:23.597043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:23.599701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:23.610324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:23.610890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:23.611447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:23.612257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:23.612753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:23.613217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:23.655153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3767dd81-501a-4d3a-9f32-b041d82e0b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064322 Aug 31 12:26:23.655909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 576/1124] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:24.327160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:24.329513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:24.336260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:24.336864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:24.337295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:24.338035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:24.338483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:24.339003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:24.375280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4338c606-9c6e-4d48-bffb-e963acb9a286 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052438 Aug 31 12:26:24.375999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 549/1125] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:24.525372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:24.527821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:24.534854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:24.535702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:24.536211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:24.540023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:24.540594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:24.541019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:24.583976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-604973dc-7e96-428c-8256-a2b3bde9f6a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062982 Aug 31 12:26:24.584532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 577/1126] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:24.669597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:24.672058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:24.681623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:24.681623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:24.681623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:24.682234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:24.682520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:24.682953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:24.725894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bcbc201f-2379-4817-9f3a-c8bd8b2d38f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060002 Aug 31 12:26:24.726538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 550/1127] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:25.389876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:25.392236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:25.401969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:25.402471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:25.402914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:25.403699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:25.404161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:25.404596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:25.445024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26f9afb9-72ae-4c7f-990c-0ac6d7ba2407 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058765 Aug 31 12:26:25.446067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 578/1128] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:25.599097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:25.602856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:25.612156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:25.612707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:25.613247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:25.614068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:25.614612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:25.615339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:25.655321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37952a06-3115-4f0a-9cca-09c7cae3abdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060302 Aug 31 12:26:25.655923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 551/1129] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:25.742779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:25.746028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:25.756133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:25.757018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:25.757792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:25.759021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:25.759917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:25.760675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:25.821014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-609dad63-4a8e-420c-9f52-3c4ea3b5d7e7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083043 Aug 31 12:26:25.822090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 579/1130] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:26.463407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:26.467406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:26.483556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:26.484295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:26.484933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:26.485839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:26.486385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:26.486957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:26.526057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2c60751f-704d-4969-ad2d-e7cac2923917 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071535 Aug 31 12:26:26.526797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 552/1131] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:26.673182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:26.675743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:26.683497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:26.684051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:26.684582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:26.685366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:26.685861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:26.686313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:26.689664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:26.743915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e3c105df-cf99-4183-9804-ad24dcb3d8b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074914 Aug 31 12:26:26.744808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 580/1132] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:26.838936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:26.842454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:26.851684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:26.852247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:26.852683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:26.853400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:26.853902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:26.854473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:26.900566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5492163b-040b-4e7a-a649-ae1733b7f946 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067732 Aug 31 12:26:26.901441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 553/1133] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:27.543485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:27.546360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:27.553685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:27.554416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:27.555074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:27.555964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:27.556434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:27.556862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:27.592713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49d0b2b3-2836-4bac-957f-81e77462a7b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056093 Aug 31 12:26:27.593309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 581/1134] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:27.758232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:27.761020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:27.768505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:27.769049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:27.769571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:27.770436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:27.770977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:27.771556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:27.821217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c0ab10d-b1fa-49b7-a454-81740ac0ab18 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067316 Aug 31 12:26:27.822086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 554/1135] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:27.915579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:27.917937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:27.926001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:27.926496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:27.926934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:27.927707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:27.928264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:27.928712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:27.983993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4e0c1fd-335b-4ca9-b5bb-0503bef42b39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073214 Aug 31 12:26:27.984899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 582/1136] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:28.607349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:28.609862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:28.612218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=82 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:28.620189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:28.620875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:28.621411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:28.622293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:28.622884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:28.623457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:28.660853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-575cc677-06ce-45c1-b67b-38d8f5c16095 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058646 Aug 31 12:26:28.661640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 555/1137] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:28.837879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:28.840546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:28.849179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:28.849940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:28.850513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:28.851424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:28.853454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:28.853454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:28.896191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae86dcd6-c4dd-4c02-b55d-d85690e6694f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062253 Aug 31 12:26:28.896836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 583/1138] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:29.003099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:29.006105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:29.013919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:29.014408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:29.014840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:29.015789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:29.016576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:29.017273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:29.063125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d88bcb4-f99c-4ec1-ba29-76b51f6a130f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067578 Aug 31 12:26:29.063763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 556/1139] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:29.677783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:29.680267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:29.688451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:29.689127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:29.689650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:29.690450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:29.690896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:29.691368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:29.745414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d177c8b6-5efd-4be0-bc76-a49b74726b4a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071867 Aug 31 12:26:29.746012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 584/1140] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:29.917275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:29.920886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:29.930310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:29.930742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:29.931530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:29.932757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:29.933483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:29.933945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:29.982274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-df902814-28e4-470d-93f6-50609c2bf701 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074987 Aug 31 12:26:29.982883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 557/1141] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:30.082423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:30.086258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:30.097375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:30.098149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:30.098833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:30.099851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:30.100360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:30.100861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:30.153087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-874cc8ce-6afa-45e5-87f2-ca58a060a4c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079963 Aug 31 12:26:30.153742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 585/1142] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:30.768742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:30.772944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:30.785715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:30.786554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:30.787509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:30.789436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:30.790271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:30.791061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:30.856344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2de0be41-0966-4d30-872d-5a8b037fe836 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096880 Aug 31 12:26:30.857378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 558/1143] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:30.996124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:30.998448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:31.006360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:31.007050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:31.007632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:31.008465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:31.009102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:31.009614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:31.049819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-301d498b-bd64-4dc7-ad19-41f29496ce2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057786 Aug 31 12:26:31.050520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 586/1144] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:31.170901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:31.173266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:31.180631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:31.181189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:31.181637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:31.182410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:31.182871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:31.183293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:31.199582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:31.222079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-becc3466-5664-416a-8222-b8435875cee6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055531 Aug 31 12:26:31.222674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 559/1145] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:31.876829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:31.880337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:31.890637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:31.891512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:31.892219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:31.893387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:31.894193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:31.894891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:31.938856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44a6d921-d549-43d8-b528-e7f82f7ea3fb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069199 Aug 31 12:26:31.939497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 587/1146] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:32.064666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:32.067227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:32.075875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:32.076607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:32.077227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:32.078057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:32.078616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:32.079138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:32.119055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a65ce4b9-3798-4f1a-9d9f-529d0f512627 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059013 Aug 31 12:26:32.119805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 560/1147] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:32.238330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:32.241164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:32.251053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:32.251639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:32.252075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:32.252793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:32.253240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:32.253661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:32.294109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f7b6f62-3d4c-4d6c-989a-fa2aa8f6f158 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059848 Aug 31 12:26:32.294871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 588/1148] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:32.956134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:32.958659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:32.967068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:32.967828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:32.968435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:32.969357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:32.970060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:32.970542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:33.009686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26ce9736-600c-4ff2-a957-22d383d59638 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058772 Aug 31 12:26:33.010356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 561/1149] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:33.135403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:33.137934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:33.147896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:33.148358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:33.148807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:33.150334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:33.150334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:33.150815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:33.201440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e07bbf0-6eeb-49bf-ab8d-d378ea6ca7ff tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069209 Aug 31 12:26:33.201440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 589/1150] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:33.308028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:33.310822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:33.319046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:33.319788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:33.320386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:33.321404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:33.322182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:33.322704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:33.366543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e1319644-ef24-4f0f-ae76-26441eed4b13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062761 Aug 31 12:26:33.367673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 562/1151] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:34.025312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:34.028156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:34.036740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:34.037298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:34.038101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:34.039067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:34.039569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:34.040179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:34.091272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-47c60aed-2e61-4c87-b6e8-ce8bc71c4ca5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070827 Aug 31 12:26:34.091868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 590/1152] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:34.218145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:34.220860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:34.229143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:34.229741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:34.230215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:34.231168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:34.231786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:34.232283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:34.270624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37012f60-833f-48d4-ac3d-bf340137d848 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056981 Aug 31 12:26:34.271544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 563/1153] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:34.381630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:34.384403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:34.392512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:34.393006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:34.393443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:34.394182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:34.394637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:34.395059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:34.437773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99ff7a9e-1cd2-4928-b25e-e6de6936ec34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060621 Aug 31 12:26:34.438369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 591/1154] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:35.106082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:35.108725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:35.116946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:35.117585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:35.118124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:35.119069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:35.119706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:35.120211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:35.161539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d40dcf49-5fb4-4712-a9f9-431b2f698090 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059936 Aug 31 12:26:35.162193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 564/1155] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:35.285525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:35.288195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:35.296745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:35.296745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:35.297222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:35.297953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:35.298418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:35.298846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:35.336730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91c4aa8f-1d57-4a3c-a7c6-841ef27a1c9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055966 Aug 31 12:26:35.337401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 592/1156] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:35.455590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:35.459761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:35.470600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:35.471529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:35.472310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:35.473596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:35.474600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:35.475391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:35.535254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78ea68a8-4286-450a-ab81-d895b08a49c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087452 Aug 31 12:26:35.536330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 565/1157] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:36.175732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:36.178735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:36.186377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:36.186889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:36.187386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:36.188288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:36.188838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:36.189352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:36.229041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-245c7327-f1f2-4d85-a9b0-7d0ad99214b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057597 Aug 31 12:26:36.229638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 593/1158] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:36.353592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:36.356433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:36.365134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:36.366431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:36.366431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:36.367391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:36.367750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:36.368418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:36.418391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c575b5c-23d3-49f5-8511-cf6fef49efdb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069903 Aug 31 12:26:36.419016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 566/1159] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:36.555858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:36.560124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:36.566220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:36.567029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:36.567532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:36.568385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:36.569646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:36.570143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:36.620725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b6bd115a-7ed2-4156-a376-44be30d1f378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070238 Aug 31 12:26:36.621164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 594/1160] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:37.244576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:37.246903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:37.254589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:37.255102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:37.255567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:37.256423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:37.257014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:37.257537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:37.313095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-75716eb3-1797-4a0f-96d8-b30e04d9820c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074301 Aug 31 12:26:37.314078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 567/1161] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:37.436800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:37.439622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:37.449146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:37.449614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:37.450260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:37.451111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:37.451665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:37.452190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:37.493539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4a9ac60b-e9e7-423e-b907-30fd42aa39ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062518 Aug 31 12:26:37.494554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 595/1162] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:37.640062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:37.643934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:37.655640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:37.656567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:37.657245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:37.658513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:37.659370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:37.660425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:37.720275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-606a137e-87be-4693-a5de-84e7aa5711a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087688 Aug 31 12:26:37.721397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 568/1163] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:38.332642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:38.336168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:38.343618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:38.344718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:38.344718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:38.345622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:38.346155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:38.346663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:38.380990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:38.386883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-55e6f05d-5c3d-4fde-ac4e-5065c3cf819a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060591 Aug 31 12:26:38.387658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 596/1164] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:38.511373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:38.515407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:38.526693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:38.527564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:38.528305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:38.529530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:38.530339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:38.531125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:38.597534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da8f05d0-d506-47bf-ac48-cd284882108c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093971 Aug 31 12:26:38.598233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 569/1165] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:38.738385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:38.741173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:38.749407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:38.749908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:38.750347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:38.751161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:38.751667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:38.752107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:38.789657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44c1d05d-c80c-451d-9b12-52758c012c04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056447 Aug 31 12:26:38.790304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 597/1166] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:39.401617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:39.404082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:39.412229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:39.412721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:39.413249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:39.413984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:39.414469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:39.414904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:39.463675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b422cd7-68cb-49cf-99ba-2c2cf9d44bdc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066461 Aug 31 12:26:39.467267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 570/1167] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:39.620240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:39.624105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:39.635689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:39.636537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:39.637284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:39.638524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:39.639410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:39.640176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:39.685405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-625210b7-1cc6-4926-91a3-a40658aab010 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072151 Aug 31 12:26:39.686374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 598/1168] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:39.808878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:39.811443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:39.819794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:39.820448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:39.820997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:39.821833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:39.822479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:39.823584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:39.875731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e12517cc-711e-4e4a-ab8b-cf7a15bd59ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074042 Aug 31 12:26:39.877287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 571/1169] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:40.479550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:40.482373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:40.495368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:40.496370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:40.497210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:40.498374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:40.499316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:40.500107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:40.561902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-63e01746-83e2-4632-a5b4-59470acb01d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087660 Aug 31 12:26:40.562639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 599/1170] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:40.702523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:40.705276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:40.714079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:40.714784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:40.715581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:40.716566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:40.717284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:40.718008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:40.756129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-29fd1b24-98c7-4feb-82b0-d2ec2b773a5c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057884 Aug 31 12:26:40.757000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 572/1171] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:40.892978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:40.896536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:40.904487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:40.905128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:40.905691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:40.906526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:40.907027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:40.907547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:40.957601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d58e8c6d-bf80-45f3-a001-3e2fb1021425 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070195 Aug 31 12:26:40.958597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 600/1172] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:41.579685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:41.581932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:41.589242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:41.589738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:41.590202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:41.590892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:41.591380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:41.591804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:41.633239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5198ab70-99a3-4649-b042-080dda11ceda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056332 Aug 31 12:26:41.633239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 573/1173] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:41.774487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:41.776925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:41.779584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=84 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:41.785985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:41.786472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:41.787060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:41.788674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:41.789123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:41.789554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:41.837185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4d7e68dc-c8be-4dec-a550-3e74beef1d91 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070853 Aug 31 12:26:41.837671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 601/1174] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:41.979669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:41.982271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:41.990251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:41.991019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:41.991724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:41.992491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:41.993446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:42.002816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:42.030900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bead62f0-4c43-4b7c-9e51-4122378f698d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060295 Aug 31 12:26:42.031549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 574/1175] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:42.649378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:42.653164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:42.663906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:42.664691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:42.665385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:42.666561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:42.667350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:42.668071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:42.714470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-16a86a54-9e65-437d-bcdc-5e3f5108ea8f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072019 Aug 31 12:26:42.715110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 602/1176] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:42.854076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:42.857159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:42.866531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:42.867029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:42.867507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:42.868243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:42.868702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:42.869134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:42.905527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f384f97b-ad53-4112-8107-6c4e02f97be5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058129 Aug 31 12:26:42.906414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 575/1177] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:43.049648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:43.053734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:43.065822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:43.066690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:43.067503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:43.068790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:43.069671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:43.070434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:43.128318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d0c830d-b801-4dbe-840e-3c7175749a3e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086082 Aug 31 12:26:43.129391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 603/1178] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:43.730084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:43.732403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:43.741502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:43.742028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:43.742587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:43.743609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:43.744197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:43.744623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:43.747549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:43.795123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-287ef497-c8dc-465f-a191-504465a17764 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070142 Aug 31 12:26:43.796189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 576/1179] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:43.920644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:43.923049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:43.931775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:43.932328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:43.933222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:43.933605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:43.934162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:43.934626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:43.976906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-813671dd-46f9-4baa-81cd-6a5c1ed9fbd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061157 Aug 31 12:26:43.977649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 604/1180] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:44.149155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:44.152578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:44.163635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:44.164152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:44.164590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:44.165318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:44.165772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:44.166196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:44.207344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55464183-c532-4075-91f5-7b8006e34814 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063789 Aug 31 12:26:44.208369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 577/1181] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:44.811381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:44.814695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:44.823914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:44.824726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:44.825423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:44.826670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:44.827461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:44.828191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:44.879302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4dcef9d4-8864-4786-b8ba-b57c10e6d337 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072156 Aug 31 12:26:44.880290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 605/1182] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:44.994244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:44.998027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:45.008532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:45.009139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:45.009830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:45.011040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:45.011916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:45.012635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:45.073376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-170548cb-8db5-491c-b553-b5512c889c12 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086428 Aug 31 12:26:45.074355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 578/1183] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:45.222874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:45.226515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:45.236343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:45.237031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:45.237710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:45.238886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:45.239633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:45.240524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:45.295259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-edb7246c-a7fd-4169-bcd9-32db8d697a30 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077523 Aug 31 12:26:45.296039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 606/1184] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:45.899074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:45.899074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:45.906365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:45.906918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:45.907397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:45.908240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:45.908709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:45.909138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:45.953156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb563127-ba5d-48bd-913a-498fe561ac03 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062392 Aug 31 12:26:45.957876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 579/1185] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:46.094768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:46.097723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:46.105465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:46.105955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:46.106493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:46.107210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:46.107705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:46.108118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:46.146550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e9aa9ea-2c8a-4842-b641-01ead015eb66 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059573 Aug 31 12:26:46.147473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 607/1186] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:46.312575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:46.315089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:46.322986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:46.323512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:46.323954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:46.324695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:46.325135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:46.325560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:46.362311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-41f6b9e7-e3f8-4b6d-a42c-0934a4c876e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053795 Aug 31 12:26:46.362888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 580/1187] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:46.968977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:46.972202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:46.980079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:46.980723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:46.981287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:46.982144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:46.982751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:46.983450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:47.026804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a128e5a-04fb-4aaa-9be1-ac42d474a8ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064156 Aug 31 12:26:47.027476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 608/1188] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:47.160660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:47.162990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:47.169824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:47.170318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:47.170759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:47.171593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:47.172169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:47.172643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:47.210604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-330f842c-3455-47cf-9474-98e9ae6aaafc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054277 Aug 31 12:26:47.211243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 581/1189] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:47.381325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:47.385250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:47.396941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:47.397846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:47.398606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:47.399977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:47.400780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:47.401515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:47.464975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a2cde1d8-312d-48cb-9966-0532dd65fa52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091907 Aug 31 12:26:47.466058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 609/1190] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:48.040561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:48.042787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:48.050603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:48.051208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:48.051735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:48.052633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:48.053232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:48.053719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:48.091340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a01581c8-bb9b-4485-b733-826060ec866e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055500 Aug 31 12:26:48.092110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 582/1191] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:48.226740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:48.229089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:48.237721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:48.238443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:48.238997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:48.240190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:48.240740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:48.241271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:48.279555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-749aa4e2-7f50-4600-a5e6-7876901ffd55 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058156 Aug 31 12:26:48.280359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 610/1192] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:48.479922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:48.482469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:48.491803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:48.492350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:48.492927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:48.493697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:48.494276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:48.494737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:48.536564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d884c9f-a031-49df-8d1d-7eda2fb1498d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061239 Aug 31 12:26:48.537192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 583/1193] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:49.111086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:49.120339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:49.140521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:49.140521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:49.140521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:49.141516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:49.142324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:49.143062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:49.182264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b1c4283-4e42-4219-ad88-e364257693ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079602 Aug 31 12:26:49.182755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 611/1194] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:49.293938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:49.296462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:49.304722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:49.305345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:49.305879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:49.306753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:49.307432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:49.307963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:49.358517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-71b11761-af69-44a9-b3a0-8f5becaa517d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068753 Aug 31 12:26:49.359159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 584/1195] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:49.549842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:49.554009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:49.561661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:49.562302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:49.562846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:49.563904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:49.564462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:49.564990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:49.605386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-51816f89-1d0f-4690-bce2-fa93f7887e72 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060053 Aug 31 12:26:49.606117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 612/1196] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:50.198865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:50.201339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:50.208680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:50.209169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:50.209598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:50.210309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:50.210752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:50.211177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:50.249592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c88bcd7f-7bd3-426b-85bb-f3ac95eff84b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055919 Aug 31 12:26:50.250256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 585/1197] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:50.373546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:50.376004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:50.385246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:50.385719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:50.386161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:50.386904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:50.387421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:50.387855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:50.405369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:50.431791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41dc5aaa-4f8e-4d45-bc5f-97f4cc2468b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063165 Aug 31 12:26:50.432550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 613/1198] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:50.624052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:50.628002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:50.640778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:50.641594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:50.642284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:50.643542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:50.644343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:50.645144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:50.690887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-21d3ce25-8ae4-4c0b-b2ee-020846626be1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074270 Aug 31 12:26:50.691913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 586/1199] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:51.263710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:51.266248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:51.274129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:51.274764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:51.275349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:51.276284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:51.276844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:51.277443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:51.316462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f87bd050-7f46-4654-a719-ef2328d174b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057158 Aug 31 12:26:51.317264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 614/1200] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:51.447694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:51.449997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:51.458101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:51.458738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:51.459265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:51.462138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:51.462614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:51.463051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:51.499610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8da42266-9b3e-4525-bfe9-2e094c769874 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058116 Aug 31 12:26:51.500492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 587/1201] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:51.707516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:51.710180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:51.719662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:51.720346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:51.720896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:51.721787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:51.722394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:51.722921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:51.763914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6abf68b6-685f-448b-a522-c22417eb8aa5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061039 Aug 31 12:26:51.764577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 615/1202] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:52.337670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:52.341692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:52.354841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:52.355707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:52.356547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:52.357899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:52.358721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:52.359527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:52.406566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf6871a5-cd26-4ab7-b1c5-aafa8f3e3aaa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076705 Aug 31 12:26:52.407368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 588/1203] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:52.515033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:52.517817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:52.524873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:52.525427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:52.525952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:52.526753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:52.527294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:52.527780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:52.565703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fcb3b7a9-a92c-4b9c-9418-dd20e0dfb49c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055966 Aug 31 12:26:52.566503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 616/1204] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:52.782006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:52.784973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:52.792960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:52.793840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:52.794592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:52.795891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:52.796580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:52.797200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:52.839802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bcfde937-f06a-4166-adac-b8c6816fb98b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063366 Aug 31 12:26:52.840469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 589/1205] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:53.426806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:53.431062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:53.443673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:53.444482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:53.445215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:53.446362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:53.446896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:53.447448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:53.486661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a12ea9e0-fdb1-433b-be85-12637d2f75fa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066047 Aug 31 12:26:53.487564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 617/1206] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:53.581722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:53.585810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:53.598587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:53.600208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:53.601373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:53.602991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:53.604007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:53.604839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:53.647611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0c7c1069-5db0-4057-9760-a2e04527f43d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072217 Aug 31 12:26:53.648481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 590/1207] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:53.855463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:53.857892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:53.866857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:53.867389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:53.867831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:53.868557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:53.869007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:53.869427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:53.916638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b0f5952-cdb8-4742-aa0c-1efc86d49f84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065894 Aug 31 12:26:53.917320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 618/1208] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:54.504467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:54.510014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:54.532376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:54.533199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:54.533923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:54.535447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:54.536196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:54.537035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:54.605118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14619b48-8ffa-49b0-aed7-b2a81ebc953f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106986 Aug 31 12:26:54.607357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 591/1209] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:54.663411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:54.665791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:54.676161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:54.677125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:54.677984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:54.679518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:54.680309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:54.681030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:54.726190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5f8a7c0d-616b-4d80-8469-d2064c8712b0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068118 Aug 31 12:26:54.726794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 619/1210] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:54.931923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:54.934340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:54.941873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:54.942355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:54.942820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:54.943589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:54.944073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:54.944621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:54.976224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:54.984100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ad7751e-ed40-48d0-9803-ff3bd0243eaf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057466 Aug 31 12:26:54.984729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 592/1211] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:55.619472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:55.621719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:55.629094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:55.629640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:55.630148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:55.631379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:55.632039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:55.632536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:55.684331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-56437029-993e-4f80-953c-aa70b5bbff06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069765 Aug 31 12:26:55.684924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 620/1212] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:55.743813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:55.746156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:55.754175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:55.754781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:55.755416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:55.756677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:55.757235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:55.757760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:55.801444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3eae43f4-7aa9-47d6-97c9-0a9ad3401836 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063442 Aug 31 12:26:55.802398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 593/1213] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:55.997495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:56.000202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:56.009530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:56.010159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:56.010574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:56.011342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:56.011803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:56.012266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:56.050003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-739c05f3-17cd-4269-b50f-0d5d16adb507 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056715 Aug 31 12:26:56.050715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 621/1214] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:56.701157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:56.703386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:56.711429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:56.711939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:56.712362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:56.713095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:56.713868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:56.714589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:56.758039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c174256e-c5c2-4c49-b72f-f110163aa6cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061756 Aug 31 12:26:56.759126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 594/1215] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:26:56.817047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:56.820393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:56.828328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:56.829048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:56.829674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:56.830505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:56.831067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:56.831621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:56.870065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-059c446f-b0a6-4688-af1c-27740a92fdca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058050 Aug 31 12:26:56.870662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 622/1216] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:57.064986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:57.068118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:57.075520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:57.076107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:57.076690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:57.077679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:57.078366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:57.078898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:57.115078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-089d685c-0419-4711-8988-77b0495055b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054438 Aug 31 12:26:57.115717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 595/1217] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:57.773354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:57.775905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:57.790735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:57.791632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:57.792353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:57.793604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:57.794408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:57.795172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:57.853663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a9db4ff9-913c-4fef-89cf-7ce628289ac1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086292 Aug 31 12:26:57.854717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 623/1218] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:57.886663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:57.888959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:57.898858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:57.900235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:57.900235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:57.900967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:57.901474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:57.902030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:57.940126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b694a2e-bc5b-4eec-8d5c-17a738f0dcb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057515 Aug 31 12:26:57.940794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 596/1219] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:26:58.128864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:58.131291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:58.138730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:58.139449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:58.139818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:58.140592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:58.141182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:58.141644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:58.194742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00697fe9-1cf7-457d-8409-833bb4b87517 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069825 Aug 31 12:26:58.195049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 624/1220] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:58.871674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:58.875467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:58.879497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=84 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:58.889304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:58.890110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:58.890871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:58.891918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:58.892578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:58.893308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:58.952550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8d1d030-51df-4037-8a44-e2a1fb1b782e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088807 Aug 31 12:26:58.953764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 597/1221] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:58.960210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:58.964868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:58.979363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:58.980235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:58.981061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:58.982362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:58.983223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:58.983992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:59.047313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bfd5e4dc-976a-4216-9dcd-c1e1b2d44d11 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096338 Aug 31 12:26:59.048338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 625/1222] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:26:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:26:59.211045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:59.213756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:59.223136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:59.223975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:59.224764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:59.226023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:59.226793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:59.227449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:59.270582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d1843da-6687-4adf-b161-459c015ef4ae tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065498 Aug 31 12:26:59.271507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 598/1223] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:26:59.970584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:26:59.973638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:26:59.982729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:59.984100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:59.984399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:26:59.985630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:26:59.986414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:26:59.987362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:00.032443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-15f78785-5443-407e-a9b2-6c7389e02169 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067125 Aug 31 12:27:00.033008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 626/1224] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:26:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:00.063525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:00.065933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:00.073602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:00.074112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:00.074545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:00.075312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:00.075775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:00.076202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:00.113175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e0badc13-599a-458e-8976-010d84c04494 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056200 Aug 31 12:27:00.113800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 599/1225] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:00.285421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:00.288059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:00.295754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:00.296418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:00.296955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:00.297737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:00.298344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:00.298851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:00.342446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f068cab5-60e4-40bd-92d0-7bbe386cd293 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061469 Aug 31 12:27:00.343086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 627/1226] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:01.047401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:01.049869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:01.058421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:01.058908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:01.059379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:01.060092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:01.060542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:01.060967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:01.097488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-23fc1ec8-28a0-499d-a2ea-939f32c320d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054152 Aug 31 12:27:01.098753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 600/1227] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:01.129869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:01.132530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:01.140006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:01.140724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:01.141400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:01.142524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:01.143111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:01.143569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:01.189051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7ed0ed62-3dfd-4f89-915f-de355ea71b2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063509 Aug 31 12:27:01.190036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 628/1228] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:01.359145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:01.361025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:01.368544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:01.369040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:01.369484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:01.370218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:01.370676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:01.371329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:01.418523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0e11394f-6cf1-4398-8915-0b6e4d875606 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065074 Aug 31 12:27:01.419450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 601/1229] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:02.111659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:02.113962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:02.122170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:02.122698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:02.123133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:02.123919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:02.124378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:02.124805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:02.167789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-11744eac-b467-478c-a55f-fd27d4b00703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060558 Aug 31 12:27:02.168886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 629/1230] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:02.205523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:02.208959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:02.218209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:02.218744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:02.219223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:02.220053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:02.220606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:02.221079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:02.258452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7736747-dce9-42cb-81a4-e2e6dbb5ba6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058153 Aug 31 12:27:02.259063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 602/1231] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:02.438439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:02.441095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:02.449097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:02.449650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:02.450216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:02.451123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:02.451677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:02.452154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:02.455364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:02.498754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7668f155-360b-4e1b-acd3-3837d354a1b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065264 Aug 31 12:27:02.499385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 630/1232] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:03.184969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:03.188644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:03.199757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:03.200591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:03.201345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:03.202659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:03.204556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:03.204556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:03.265390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c485686a-162e-4e47-8700-96c4b1c5928a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087562 Aug 31 12:27:03.266117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 603/1233] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:03.276737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:03.279226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:03.291757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:03.292580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:03.293319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:03.294584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:03.295413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:03.296176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:03.344924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82cefdbe-d57e-4314-a8b0-4807707eee59 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073211 Aug 31 12:27:03.345526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 631/1234] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:03.515725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:03.517879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:03.530900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:03.531803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:03.533239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:03.533733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:03.534652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:03.535146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:03.592927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8be76c7-8009-4b7d-9758-20354bc7cf3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081865 Aug 31 12:27:03.594047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 604/1235] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:04.281464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:04.284950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:04.295505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:04.296221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:04.296822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:04.297846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:04.298481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:04.299060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:04.357164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b14a8944-3965-481c-bacd-f73ebdaa6d9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079892 Aug 31 12:27:04.358212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 632/1236] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:04.360153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:04.362689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:04.370406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:04.371039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:04.371657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:04.372479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:04.372999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:04.373468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:04.425424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2da9e893-eefa-454a-b35c-d422732780d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070494 Aug 31 12:27:04.426437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 605/1237] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:04.610380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:04.614573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:04.626283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:04.627131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:04.627971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:04.629208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:04.631018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:04.632034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:04.692681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b72bedbd-dd26-421b-8ccd-f27d3b0c02fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086896 Aug 31 12:27:04.693919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 633/1238] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:05.378045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:05.381991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:05.394462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:05.395411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:05.396181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:05.397533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:05.398313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:05.399106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:05.444264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:05.447951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:05.454321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-102d1fa3-083a-4aad-8036-8e6b6af59a57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083896 Aug 31 12:27:05.455159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 606/1239] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:05.459425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:05.459926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:05.460359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:05.461082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:05.461529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:05.461945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:05.508569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a8715780-2e80-4de3-98d0-00dd8a1eea95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070409 Aug 31 12:27:05.509410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 634/1240] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:05.709383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:05.711681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:05.718544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:05.719117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:05.719587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:05.720313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:05.720773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:05.721200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:05.760338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff33fda3-f2c1-4e93-83cb-4b3987cc6d16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054974 Aug 31 12:27:05.760947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 607/1241] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:06.469546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:06.471986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:06.481662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:06.482197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:06.482638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:06.483420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:06.484006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:06.484445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:06.526235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:06.530117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:06.537732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-35466dad-1ef2-4bb6-b8c4-5985a86c3db1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072532 Aug 31 12:27:06.538783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 635/1242] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:06.542465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:06.543336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:06.544103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:06.545336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:06.546126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:06.546879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:06.609512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-571eb93d-4ec3-4c3b-94fc-d066855fe58f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090586 Aug 31 12:27:06.610557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 608/1243] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:06.786762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:06.789221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:06.796235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:06.796734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:06.797181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:06.797933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:06.798392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:06.798819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:06.839693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6960221e-b720-4611-8c48-2e55af7f96b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061196 Aug 31 12:27:06.840505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 636/1244] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:07.558884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:07.561646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:07.569088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:07.569583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:07.570022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:07.571098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:07.571710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:07.572444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:07.596602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:07.626078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0b6353d-59a9-4297-ab8f-2807dacfb6af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075893 Aug 31 12:27:07.627536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 609/1245] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:07.628401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:07.632485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:07.640124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:07.640630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:07.641079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:07.641832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:07.642298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:07.642796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:07.680862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c9cca2c9-4145-4c60-8da1-63efb008a016 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061186 Aug 31 12:27:07.681459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 637/1246] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:07.859929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:07.863611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:07.875977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:07.876854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:07.877634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:07.878904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:07.879865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:07.880525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:07.937270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-41aedbee-f7ad-491a-9368-4af7e6e70879 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084539 Aug 31 12:27:07.938313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 610/1247] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:08.642656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:08.645896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:08.655547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:08.656040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:08.656470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:08.657193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:08.657643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:08.658062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:08.698306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:08.701940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d0fd380-b156-4761-a529-51babd79cebd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064392 Aug 31 12:27:08.702307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:08.702628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 638/1248] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:08.714760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:08.715609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:08.716374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:08.717609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:08.718366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:08.719122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:08.777938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0dfff69-aa02-426b-979b-7db2763ae768 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086577 Aug 31 12:27:08.778989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 611/1249] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:08.958115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:08.962197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:08.975433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:08.976285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:08.977104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:08.978415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:08.979302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:08.980092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:09.023573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eab31a95-4fa9-4a37-aa4a-9829d09474e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072950 Aug 31 12:27:09.024168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 639/1250] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:09.718586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:09.721126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:09.728927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:09.729420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:09.729919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:09.730652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:09.731108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:09.731563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:09.773448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4a03c2d-d32a-4a87-aa09-155d2c6c63df tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058802 Aug 31 12:27:09.774438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 612/1251] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:09.791882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:09.794195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:09.804258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:09.805116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:09.805889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:09.807158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:09.807881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:09.808320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:09.849302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a36709e7-900d-4033-b757-993fad99c3ad tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061237 Aug 31 12:27:09.849902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 640/1252] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:10.039344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:10.041653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:10.050732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:10.051342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:10.051776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:10.052719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:10.053182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:10.053604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:10.090115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0a711ab-f657-4255-80d3-fc505864bb2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054913 Aug 31 12:27:10.090801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 613/1253] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:10.791679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:10.794794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:10.803220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:10.803890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:10.804403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:10.805202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:10.805859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:10.806420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:10.844203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ce773199-3ff3-4aa2-95c6-16a16ab975cf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056806 Aug 31 12:27:10.844967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 641/1254] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:10.867495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:10.871273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:10.884611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:10.885441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:10.886200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:10.887495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:10.888347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:10.889095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:10.933306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1ebf289b-5ce4-460e-a583-8a509d7f00a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074014 Aug 31 12:27:10.934052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 614/1255] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:11.106521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:11.110247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:11.117913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:11.118416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:11.118853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:11.119645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:11.120103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:11.120529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:11.166585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3103fe1f-76cb-49dd-869a-67a7699c580d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066220 Aug 31 12:27:11.167282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 642/1256] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:11.861173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:11.863426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:11.871633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:11.872563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:11.872833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:11.874032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:11.874800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:11.875541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:11.925624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-170fa333-1cfa-41f2-909c-c9957c1b6997 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068616 Aug 31 12:27:11.926786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 615/1257] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:11.952200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:11.956537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:11.960844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=84 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:11.971833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:11.972709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:11.974046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:11.974802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:11.975689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:11.976428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:12.030357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb453801-e8bd-4a6c-a9bf-dc2f05a1be81 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085862 Aug 31 12:27:12.031403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 643/1258] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:12.180401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:12.182561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:12.192363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:12.193329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:12.194282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:12.195590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:12.196446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:12.197208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:12.260302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c33d2b5a-190f-47f6-9292-4c0909cc63c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084235 Aug 31 12:27:12.261302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 616/1259] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:13.036309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:13.038587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:13.045890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:13.046441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:13.046916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:13.047684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:13.048138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:13.048561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:13.051105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:13.054794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:13.063842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:13.064702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:13.065486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:13.066791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:13.067661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:13.068410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:13.085654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-402af246-9237-4ed6-8616-7899e7c03d53 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053903 Aug 31 12:27:13.086239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 644/1260] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:13.128213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-818eaa57-fa0d-4c49-a6b7-b87359ace742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084309 Aug 31 12:27:13.129279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 617/1261] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:13.276603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:13.279001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:13.287869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:13.288366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:13.288809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:13.289537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:13.289994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:13.290419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:13.329879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-722a1ab9-376a-45b8-a170-2ee0a5af5378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057639 Aug 31 12:27:13.330545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 645/1262] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:14.099470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:14.102289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:14.110780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:14.111299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:14.111735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:14.112455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:14.112904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:14.113323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:14.147926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:14.149433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7273d316-0f7b-48ef-a9b2-56dc595cd7a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054396 Aug 31 12:27:14.150031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 618/1263] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:14.152012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:14.164953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:14.165803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:14.166551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:14.167861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:14.168645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:14.169424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:14.221394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:14.235716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c130efc4-a256-41ac-a420-643e05c56205 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095512 Aug 31 12:27:14.236378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 646/1264] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:14.348906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:14.350945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:14.358480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:14.358972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:14.359448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:14.360156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:14.360600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:14.361016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:14.396198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-161297e0-1f85-43ab-a314-93cb5b8fa909 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055552 Aug 31 12:27:14.396791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 619/1265] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:15.167120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:15.170925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:15.182760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:15.183619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:15.184394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:15.185652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:15.186477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:15.187710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:15.249647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-52bf534d-cb90-4e1d-9bf1-cf8a8a94ca15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087357 Aug 31 12:27:15.250658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 647/1266] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:15.252040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:15.256405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:15.266842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:15.267461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:15.267790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:15.268616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:15.269068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:15.269569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:15.314357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f86b52b-ae6d-4602-a02e-cb224875629d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068025 Aug 31 12:27:15.314954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 620/1267] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:15.414941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:15.418604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:15.429492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:15.430330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:15.431119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:15.432464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:15.433032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:15.433469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:15.478854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-88f5ab04-0cfd-42eb-93f8-a25f1269dbe2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071871 Aug 31 12:27:15.479684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 648/1268] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:16.265328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:16.267595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:16.275371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:16.276001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:16.276536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:16.277461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:16.278006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:16.278579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:16.315044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1899351c-1de7-4651-a376-ece2e1412b80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054563 Aug 31 12:27:16.315846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 621/1269] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:16.327165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:16.329737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:16.337719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:16.338208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:16.338640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:16.339398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:16.339852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:16.340267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:16.377700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2cedae4a-cac3-49ad-bb07-44ec79868bf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054574 Aug 31 12:27:16.378474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 649/1270] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:16.497140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:16.500932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:16.513777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:16.514651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:16.515544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:16.516802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:16.517698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:16.518497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:16.562507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-19700f05-1afa-4a04-824a-ba8a30977b5b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073904 Aug 31 12:27:16.563117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 622/1271] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:17.330741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:17.333505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:17.341009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:17.341534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:17.341956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:17.342677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:17.343205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:17.343840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:17.389465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a010d9d8-ef98-4c38-9515-23f899bdc775 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064212 Aug 31 12:27:17.390394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 650/1272] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:17.391426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:17.394357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:17.402365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:17.403114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:17.403813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:17.404673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:17.405180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:17.405649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:17.446110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b669875-f181-49ad-b09f-e1661ff71021 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059289 Aug 31 12:27:17.446767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 623/1273] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:17.577948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:17.580260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:17.587528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:17.587921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:17.588368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:17.589104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:17.589694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:17.589993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:17.638098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2fb7db7a-50a5-45fd-a9f6-48d9da261059 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063530 Aug 31 12:27:17.638799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 651/1274] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:18.406969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:18.409773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:18.418856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:18.418856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:18.419578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:18.420858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:18.421609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:18.422312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:18.463869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:18.468496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:18.469583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2def44b5-3e0b-4d28-a632-f298ed005c3a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068243 Aug 31 12:27:18.470178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 624/1275] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:18.472215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:27:18.472493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:27:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments (ip 10.222.0.27) !!! Aug 31 12:27:18.482913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:18.483629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:18.484207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:18.485429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:18.486186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:18.486847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:18.544293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b48f0f6f-4922-4ec0-a162-28b4ef219815 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088617 Aug 31 12:27:18.545183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 652/1276] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:18.652504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:18.654745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:18.663657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:18.664147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:18.664580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:18.665306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:18.665806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:18.666249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:18.712797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b1fc44b-748a-411a-a3c3-d7bcc660a020 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064651 Aug 31 12:27:18.713412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 625/1277] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:19.486788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:19.490437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:19.499204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:19.500253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:19.500596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:19.501498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:19.501999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:19.502468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:19.552764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e43c4dda-569c-4de2-84a8-9175971b9784 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072866 Aug 31 12:27:19.553572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 653/1278] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:19.560254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:19.562463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:19.570302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:19.570878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:19.571415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:19.572233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:19.572773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:19.573306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:19.576631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:19.617678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec2d0f46-9651-4d9b-bbe8-53775d9be86f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061272 Aug 31 12:27:19.618571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 626/1279] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:19.730659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:19.734228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:19.745038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:19.745778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:19.746301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:19.747049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:19.747529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:19.747962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:19.785977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b22107e-a9c4-4258-b3c4-ce9a88fb78f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062696 Aug 31 12:27:19.786756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 654/1280] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:20.568346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:20.572028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:20.580299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:20.580940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:20.581515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:20.582512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:20.583084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:20.583643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:20.625069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25275017-cc54-47a3-815a-1b3a52080a04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060784 Aug 31 12:27:20.626158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 627/1281] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:20.632924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:20.635187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:20.642696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:20.643368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:20.643638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:20.644380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:20.645294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:20.645294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:20.684219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c6dc838-89d2-4614-baab-90207f6b8612 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055933 Aug 31 12:27:20.684732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 655/1282] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:20.803732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:20.807798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:20.815049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:20.815597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:20.816042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:20.816984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:20.817416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:20.817852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:20.853573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7eeaa5ab-3765-42a5-8c07-322723c558df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058100 Aug 31 12:27:20.854168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 628/1283] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:21.642393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:21.644940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:21.652316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:21.652854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:21.653384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:21.654274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:21.654782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:21.655293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:21.695145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-56de2810-d846-42a6-b808-3098d036c2ba tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057557 Aug 31 12:27:21.695805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 656/1284] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:21.701712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:21.705419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:21.717477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:21.718333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:21.719109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:21.720423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:21.721238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:21.721990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:21.782426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ecadb65a-c0b5-46d4-8f93-fba52798849c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087851 Aug 31 12:27:21.783808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 629/1285] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:21.867609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:21.870227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:21.880490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:21.881159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:21.881803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:21.883102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:21.884095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:21.884867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:21.943147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9780b208-1a50-4b70-a789-f6bc0fc40bf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080044 Aug 31 12:27:21.944233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 657/1286] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:22.714162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:22.718117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:22.726954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:22.727608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:22.728167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:22.729183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:22.729916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:22.730665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:22.767147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d4bec9f-ba7a-4874-a8c9-a1f74371209e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060073 Aug 31 12:27:22.767842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 630/1287] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:22.797236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:22.799592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:22.807672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:22.808336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:22.808879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:22.809713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:22.810283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:22.810803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:22.846506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bde56585-2011-4f68-a86d-c740f6baf5fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053825 Aug 31 12:27:22.847173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 658/1288] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:22.957776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:22.960084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:22.967316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:22.967982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:22.968594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:22.969441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:22.970091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:22.970657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:23.006554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-301333aa-2804-4038-9d01-f43b2690367c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053544 Aug 31 12:27:23.007163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 631/1289] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:23.784080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:23.786592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:23.793586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:23.794141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:23.794662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:23.795535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:23.796083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:23.796607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:23.830773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-867f8f19-83c9-425a-a1ec-f20a21953b15 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053447 Aug 31 12:27:23.831712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 659/1290] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:23.860891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:23.863140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:23.870106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:23.871193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:23.871193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:23.874772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:23.875432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:23.876011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:23.914289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fbad2d12-4bff-4f3e-9b36-687995c56695 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058518 Aug 31 12:27:23.914895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 632/1291] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:24.022126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:24.024541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:24.030982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:24.031508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:24.031962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:24.032685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:24.033143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:24.033879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:24.074190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65a6fcc9-cb67-4b6d-8a22-121cf4619d5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056041 Aug 31 12:27:24.075367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 660/1292] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:24.848023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:24.853324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:24.867511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:24.868348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:24.869103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:24.871199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:24.874249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:24.875151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:24.950119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc79e5f9-3e35-4d31-862c-f454915304c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109696 Aug 31 12:27:24.950728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 633/1293] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:24.955046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:24.959577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:24.973509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:24.974302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:24.975104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:24.976586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:24.977516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:24.978275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:25.023873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8fbc0e4b-db41-44d6-8c74-aae1e5571704 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100203 Aug 31 12:27:25.024681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 661/1294] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:25.088847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:25.091650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:25.101391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:25.101900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:25.102406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:25.103180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:25.103831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:25.104245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:25.148181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-54a9cf3d-7fc9-49b9-8e51-c0d24ec165f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063287 Aug 31 12:27:25.149158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 634/1295] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:25.968525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:25.973058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:25.986290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:25.987470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:25.988318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:25.989655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:25.990505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:25.991262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:26.042269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:26.045755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:26.049477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-35d9c8eb-f207-4958-9ec6-311b3c1260a5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087572 Aug 31 12:27:26.050593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 662/1296] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:26.057245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:26.058263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:26.059040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:26.060381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:26.061265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:26.061901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:26.102239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4907ee89-9eff-4dd1-b610-8b51ab2a80f5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067773 Aug 31 12:27:26.102980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 635/1297] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:26.167164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:26.170050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:26.179436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:26.180034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:26.180550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:26.181409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:26.181943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:26.182445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:26.210393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:26.245612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8288e90-6c11-43d4-a850-cfe759f4d0bd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083274 Aug 31 12:27:26.246558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 663/1298] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:27.071109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:27.074249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:27.086885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:27.087815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:27.088566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:27.089825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:27.090827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:27.091576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:27.121873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:27.125736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:27.138336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:27.139199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:27.139952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:27.141134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:27.141902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:27.142636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:27.160101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b43aada8-e360-4df7-9528-a1a5d183619e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097091 Aug 31 12:27:27.161494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 636/1299] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:27.207741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00072ea2-3d41-479c-89e3-89b895f66aa3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093595 Aug 31 12:27:27.208893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 664/1300] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:27.262038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:27.265075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:27.274353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:27.274990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:27.275579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:27.276428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:27.276989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:27.277537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:27.317542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-96f9f015-b965-4836-8990-84243c4ea124 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059694 Aug 31 12:27:27.318152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 637/1301] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:28.189407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:28.193635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:28.205737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:28.206603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:28.207651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:28.208952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:28.209825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:28.210611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:28.224024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:28.226782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:28.235061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:28.235780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:28.236456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:28.237420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:28.238841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:28.239474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:28.281902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8226eaed-0ddb-4a81-bed0-5dc6b6b28eda tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111348 Aug 31 12:27:28.282391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-add79c1a-907d-45ee-9ede-c53372d0561b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064015 Aug 31 12:27:28.282807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 665/1302] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:28.288834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 638/1303] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:28.332783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:28.335850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:28.345368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:28.346151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:28.346675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:28.347740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:28.348459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:28.349102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:28.390164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee72ce1a-7de3-41bc-a3b4-90e51d91c820 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062288 Aug 31 12:27:28.390978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 666/1304] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:29.303259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:29.304116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:29.307733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:29.308078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:29.312561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=84 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:29.320804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:29.321682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:29.322454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:29.323429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:29.323786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:29.324272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:29.324662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:29.325030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:29.325629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:29.326342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:29.327171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:29.327972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:29.388889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-51ee08be-d38d-4897-af7e-7acdd3b83d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092503 Aug 31 12:27:29.389181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-20390b7b-a681-4472-9082-f3172ee5f367 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093183 Aug 31 12:27:29.389970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 639/1305] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:29.390515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 667/1306] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:29.411626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:29.415439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:29.427018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:29.427944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:29.428707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:29.429992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:29.430788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:29.431606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:29.497022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a78fa0d-1228-40b7-b73b-5f3a001aa04a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095900 Aug 31 12:27:29.497714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 640/1307] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:30.406329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:30.409695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:30.412027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:30.420969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:30.422516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:30.423727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:30.424196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:30.425045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:30.425948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:30.426699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:30.429328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:30.430133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:30.430878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:30.436177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:30.436177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:30.436177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:30.483012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-71d62264-7487-4bec-8272-a546bf4e346c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083236 Aug 31 12:27:30.484128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 668/1308] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:30.501247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9bdab6b4-6e6e-4c87-93f5-303cae607965 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097648 Aug 31 12:27:30.502191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 641/1309] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:30.514764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:30.518851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:30.535277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:30.536179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:30.536963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:30.538334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:30.539179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:30.540182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:30.601939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3120195e-1f59-47c2-b6de-87ce8d7e12bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094545 Aug 31 12:27:30.602976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 669/1310] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:31.497979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:31.501312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:31.513506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.514156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.514737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.515625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.516207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.516721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.522010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:31.526379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:31.541379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.542392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.543173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.544723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.545548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.546289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.556225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:31.563355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e63a7095-6961-48f1-b9f2-04d388f09e17 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069380 Aug 31 12:27:31.564330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 642/1311] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:31.619294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f2e662b-eb69-4316-8395-4655842d69d0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107095 Aug 31 12:27:31.620422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 670/1312] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:31.624656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:31.627576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:31.637851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.638589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.639111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.640117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:31.640645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:31.641307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:31.691283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab3946ca-1a43-4ec7-a426-86d8a664f823 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072322 Aug 31 12:27:31.692203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 643/1313] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:32.579821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:32.582586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:32.598064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.598714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.599372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.600196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.601064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.601571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.637524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:32.641460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:32.652779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.653458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.653890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.654761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.655173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.655630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.666570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-704e6164-f6c6-4beb-a865-f59bb3e119c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091020 Aug 31 12:27:32.667537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 671/1314] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:32.698648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d1bfc806-bba4-40eb-8dab-4b4cdd56c7b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065900 Aug 31 12:27:32.699260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 644/1315] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:32.710688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:32.714418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:32.724912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.725790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.726552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.727802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:32.728613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:32.729342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:32.777365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-48a7c6f9-3bff-4ca3-ac92-ccd04c1e95e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073347 Aug 31 12:27:32.778443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 672/1316] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:33.686730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:33.690649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:33.702593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:33.703496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:33.704282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:33.705537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:33.706357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:33.707125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:33.712105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:33.714343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:33.721990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:33.723271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:33.723812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:33.724663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:33.725142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:33.725571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:33.764992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1f083de-5798-4b27-bae8-b8a7b91b5c51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085463 Aug 31 12:27:33.765504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e5264eb6-9de8-4b64-83bb-62d625ddb46d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057781 Aug 31 12:27:33.766010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 645/1317] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:33.766601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 673/1318] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:33.794818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:33.797307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:33.804799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:33.805294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:33.805843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:33.806688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:33.807153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:33.807611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:33.863928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ecb391e6-85bc-4dce-befb-78c390065c58 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072336 Aug 31 12:27:33.864861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 646/1319] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:34.784113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:34.785699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:34.787706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:34.789725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:34.800100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:34.801039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:34.801851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:34.802777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:34.803597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:34.803774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:34.804655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:34.804851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:34.805423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:34.805849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:34.806845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:34.807668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:34.865869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55e4b3b1-ce73-4aa7-9e9a-94b79089782c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088353 Aug 31 12:27:34.866929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 647/1320] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:34.867162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25a0a8ce-3c64-4506-8f40-5bee45a42452 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089582 Aug 31 12:27:34.868351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 674/1321] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:34.880516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:34.883103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:34.891601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:34.892156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:34.892639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:34.893557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:34.894363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:34.895205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:34.933004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4af73218-8c2c-44d6-a278-881726965e6a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056998 Aug 31 12:27:34.933691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 648/1322] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:35.880489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:35.883806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:35.884122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:35.886616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:35.899654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:35.900262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:35.900819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:35.901762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:35.901962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:35.902488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:35.903196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:35.903431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:35.903928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:35.905392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:35.906056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:35.906580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:35.953554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-94a519b9-dffc-44ac-b682-88d590cfb880 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075361 Aug 31 12:27:35.954523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 649/1323] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:35.958523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-02896015-f01c-4837-8395-3ec7c7083f92 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082669 Aug 31 12:27:35.959177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 675/1324] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:35.967387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:35.969812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:35.977736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:35.978338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:35.978792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:35.979791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:35.980297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:35.980722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:36.021903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c1f03e56-b7b9-4639-8a91-a59594fb5175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065838 Aug 31 12:27:36.022693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 650/1325] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:36.974696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:36.978489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:36.980068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:36.982044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:27:36.982311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:27:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments (ip 10.222.0.27) !!! Aug 31 12:27:36.983724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:36.995150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:36.995983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:36.996728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:36.996900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:36.997506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:36.998089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:36.998328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:36.999341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:36.999535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:37.000124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:37.000466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:37.000952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:37.061916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-32f39959-96f1-4d1b-901a-04c6294ed129 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089468 Aug 31 12:27:37.062687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf048f00-beef-48c4-9176-2534a5609c8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097565 Aug 31 12:27:37.063339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 651/1326] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:37.070552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 676/1327] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:37.072657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:37.075174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:37.083188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:37.083928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:37.084683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:37.085640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:37.086321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:37.086859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:37.125508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0c3253ca-4524-4b88-8172-6269e825e3c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060428 Aug 31 12:27:37.126100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 652/1328] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:38.081634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:38.083773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:38.084965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:38.087879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:38.093121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:38.093935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:38.094684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:38.096154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:38.097459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:38.098013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:38.110178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:38.111073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:38.111938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:38.113275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:38.114099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:38.114889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:38.145053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6edbf7e-258c-4dd0-8ab1-56cb806831b0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068673 Aug 31 12:27:38.145976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 677/1329] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:38.156814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:38.170002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:38.175840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-065ce363-403b-4cc5-a513-68f21655378c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099961 Aug 31 12:27:38.176641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 653/1330] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:38.182174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:38.183294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:38.184220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:38.185741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:38.186624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:38.187485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:38.238614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-68d96842-7d6d-4f36-82b1-f6ebfd4c9dc5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090042 Aug 31 12:27:38.239224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 678/1331] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:39.167427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:39.171362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:39.183893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:39.184724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:39.185477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:39.186860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:39.187657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:39.188440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:39.198243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:39.201284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:39.210887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:39.211647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:39.212231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:39.213180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:39.213785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:39.214586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:39.251815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40bb68df-88c6-4153-bf21-c9d5450bcfad tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091799 Aug 31 12:27:39.252967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 654/1332] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:39.255202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a6d45e7-0706-4e07-b796-3b90cf0a6d4b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065687 Aug 31 12:27:39.256049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 679/1333] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:39.264969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:39.267217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:39.279537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:39.280371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:39.281126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:39.282350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:39.283471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:39.284219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:39.343436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b39b1c06-dc8a-4e24-bf8d-1b4cfa680dc2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088377 Aug 31 12:27:39.344534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 655/1334] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:40.270630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:40.272763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:40.279021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:40.281492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:40.282441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:40.282858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:40.283526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:40.284942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:40.285812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:40.286588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:40.293971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:40.296550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:40.297545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:40.298316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:40.299762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:40.300492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:40.301205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:40.335568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d6ff372-f91e-4b6a-9c38-988fb72deb57 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070215 Aug 31 12:27:40.336273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 680/1335] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:40.351779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8462fa08-b7e4-4b83-a0c2-80278ac265b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080652 Aug 31 12:27:40.352537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 656/1336] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:40.364793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:40.368629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:40.379692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:40.380549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:40.381278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:40.382487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:40.383354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:40.384104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:40.429273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-658f925a-6fff-4353-8e6b-f56240a4181b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072356 Aug 31 12:27:40.430248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 681/1337] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:41.353215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:41.356237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:41.366216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:41.366934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:41.367470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:41.368501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:41.369157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:41.369677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:41.370698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:41.374399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:41.386874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:41.387816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:41.388594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:41.389861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:41.390750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:41.391533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:41.418217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b00e4799-6f97-42aa-9382-ed07450b733f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070084 Aug 31 12:27:41.419491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 657/1338] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:41.429855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f511f9d0-7632-442a-9959-711c61d7e951 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066639 Aug 31 12:27:41.430874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 682/1339] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:41.442974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:41.445335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:41.452639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:41.453168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:41.453652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:41.454473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:41.454973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:41.455474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:41.491145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f58675aa-2451-4b25-af9f-2ad51a842129 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052791 Aug 31 12:27:41.491916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 658/1340] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:42.437144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:42.441022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:42.446093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:42.447419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=80 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:42.448687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:42.455178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:42.456117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:42.456898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:42.458187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:42.458877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:42.459363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:42.459530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:42.459707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:42.460065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:42.461036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:42.461501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:42.461924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:42.483284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:42.520646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6169abba-b0b0-4d8a-ab46-032f43ba7a3c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079287 Aug 31 12:27:42.521572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 659/1341] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:42.522553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f184e76e-3187-45bc-b407-6c71a1c26a3f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092975 Aug 31 12:27:42.523569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 683/1342] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:42.526637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:42.529081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:42.536426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:42.536909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:42.537339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:42.538055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:42.538499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:42.538962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:42.580342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a442f8bc-6393-4dce-874d-f9b5f8b9ceb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057924 Aug 31 12:27:42.580964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 660/1343] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:43.540392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:43.541327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:43.543077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:43.543701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:43.552920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.553424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.553866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.554690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.555097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.555350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.556038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.556221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.556746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.557979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.558814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.559549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.608870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da38b075-c550-4dda-a65a-d2c4973894ea tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074708 Aug 31 12:27:43.609782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 661/1344] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:43.616651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f01a7d4-c57a-472d-a698-cb3b6e9b5ff1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083072 Aug 31 12:27:43.617409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:43.619325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 684/1345] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:43.620685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:43.630392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.631167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.631893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.633042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:43.635340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:43.635340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:43.684484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-36ee7628-598a-43c3-a734-c119b1238ee9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072932 Aug 31 12:27:43.685495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 662/1346] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:44.634419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:44.635659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:44.638840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:44.639272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:44.648063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.648799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.649445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.650300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.650646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.651003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.651467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.651685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.652154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.653326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.654060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.654747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.707794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b24c49cc-9481-42b7-9a22-d363db1e35f2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079499 Aug 31 12:27:44.712286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 663/1347] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:44.714055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:44.716361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:44.718498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72f07e8a-46f2-45f6-a40f-62326cfb9acd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092670 Aug 31 12:27:44.719466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 685/1348] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:44.728987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.729915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.730545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.731313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:44.731784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:44.732337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:44.782271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3e712d30-f3ab-4e5a-a2dd-59d60f2331a2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071771 Aug 31 12:27:44.783722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 664/1349] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:45.723559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:45.726173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:45.734517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:45.735161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:45.735727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:45.736647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:45.736899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:45.737625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:45.738266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:45.740615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:45.751565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:45.752419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:45.753218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:45.754492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:45.755391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:45.756032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:45.788439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-af17bc96-27f0-4865-b426-51b64b5b7649 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069078 Aug 31 12:27:45.789064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 686/1350] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:45.798660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:45.801646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:45.808443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:45.809094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:45.809710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:45.810536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:45.811038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:45.811486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:45.824462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a49b674d-eff4-4568-aef0-efaff5b6f4c5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094869 Aug 31 12:27:45.825438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 665/1351] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:45.849146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25940517-a0c3-46c2-a258-79aa1ef6c956 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054333 Aug 31 12:27:45.850162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 687/1352] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:46.806497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:46.810426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:46.822003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:46.822845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:46.823642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:46.824811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:46.825622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:46.826391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:46.844634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:46.848631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:46.861194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:46.862421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:46.863057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:46.864433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:46.866267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:46.867037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:46.929931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cc8d22f2-c4a6-49fc-a52a-8444006acdbf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092655 Aug 31 12:27:46.931095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 688/1353] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:46.940344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:46.944363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:46.956874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:46.957799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:46.958577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:46.959945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:46.960769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:46.961532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:47.025685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-962d982c-872a-450c-9e9e-edcbb35a71a6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092577 Aug 31 12:27:47.026755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 689/1354] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:47.074395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-91e08f6a-d040-4830-b3d0-b13caf1313ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.274595 Aug 31 12:27:47.075318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 666/1355] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:47.948532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:47.952286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:47.963938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:47.964793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:47.965558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:47.966853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:47.967695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:47.968442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:48.029083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5cda5b3e-b246-43de-b921-06bc10bef442 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087817 Aug 31 12:27:48.030022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 690/1356] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:48.043770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:48.046251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:48.054352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:48.054855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:48.055337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:48.056089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:48.056550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:48.056997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:48.094374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:48.099154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:48.110749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:48.111665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:48.112523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:48.112814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1a9a586f-5e24-4796-b5df-804a75aa2277 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074286 Aug 31 12:27:48.113608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:48.119995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 667/1357] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:48.120308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:48.120308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:48.178190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-29d2b995-bd1e-4332-b4e7-eba4d93da4da tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091345 Aug 31 12:27:48.179021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 691/1358] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:49.046967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:49.050505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:49.060162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:49.060803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:49.061477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:49.062537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:49.063153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:49.063795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:49.118820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bcf9bfad-be6a-412b-9247-2087c38e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076074 Aug 31 12:27:49.119459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 668/1359] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:49.130067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:49.133284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:49.142231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:49.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:49.143456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:49.144759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:49.145610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:49.146421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:49.188631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-beb05302-76cf-44e0-a89c-71cb98b1d7f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063678 Aug 31 12:27:49.189462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 692/1360] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:49.196860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:49.199351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:49.207485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:49.208308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:49.209060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:49.210385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:49.211214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:49.212009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:49.252959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-45d1bf69-0cfd-420d-867b-5c914a27ca50 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061233 Aug 31 12:27:49.253870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 669/1361] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:50.139412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:50.144009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:50.156105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:50.156898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:50.157696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:50.159497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:50.160423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:50.161226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:50.205150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:50.207184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2bec6c30-7459-4503-986f-b797972dd54a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074719 Aug 31 12:27:50.208779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 693/1362] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:50.209165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:50.221395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:50.222434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:50.223219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:50.224464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:50.225297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:50.226012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:50.273421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:50.277692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:50.281869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4d058c48-55df-4cb1-8e36-2ffbec44aaaa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081458 Aug 31 12:27:50.283215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 670/1363] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:50.289096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:50.289908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:50.290633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:50.291710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:50.292318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:50.293026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:50.340060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2771fe11-802d-454f-8bc7-9970ef5f39d1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073728 Aug 31 12:27:50.341002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 694/1364] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:51.227508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:51.230916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:51.239368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:51.239946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:51.240396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:51.241143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:51.241660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:51.242091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:51.283515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c0b7f92-6fb8-432e-90c2-aef06c889f2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062298 Aug 31 12:27:51.284492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 671/1365] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:51.301974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:51.305465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:51.318207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:51.319068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:51.319921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:51.321199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:51.322011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:51.322757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:51.359148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:51.363535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:51.374898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:51.375745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:51.376319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:51.377081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:51.377548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:51.377974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:51.385159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6ceccdf-ba2c-4408-bdf2-c908bd97814a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091431 Aug 31 12:27:51.386463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 695/1366] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:51.444918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3d62a139-9f99-4014-94eb-157d08795ab6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091404 Aug 31 12:27:51.445831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 672/1367] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:52.300767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:52.303427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:52.311761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:52.312533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:52.313208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:52.314035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:52.314553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:52.315214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:52.346488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:52.355951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1eae11d4-60be-4598-a2fb-fdf8f3e1f6a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059646 Aug 31 12:27:52.356693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 696/1368] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:52.402086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:52.405055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:52.414144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:52.414788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:52.415478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:52.416380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:52.416936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:52.417588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:52.462770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4df35859-39b9-49c9-b34b-c12e5411757a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064567 Aug 31 12:27:52.464065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 673/1369] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:52.465349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:52.469294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:52.479982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:52.480824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:52.481594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:52.482839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:52.483653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:52.484372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:52.546152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-635e0704-241b-4852-a3c5-54bbdff8ace8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088201 Aug 31 12:27:52.547220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 697/1370] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:53.374318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:53.376836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:53.385095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:53.385568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:53.386000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:53.386746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:53.391840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:53.391840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:53.442221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9cc5923c-b274-4448-a1de-5c5b2247dd8d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072061 Aug 31 12:27:53.443863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 674/1371] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:53.478423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:53.481108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:53.490065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:53.490729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:53.491434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:53.492298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:53.492946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:53.493518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:53.538690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d72fb160-fe15-4763-84ca-0e00dfc37870 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064032 Aug 31 12:27:53.539413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 698/1372] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:53.565056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:53.568111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:53.576150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:53.576956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:53.578019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:53.580705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:53.580705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:53.580705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:53.649917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06ae151d-584a-44de-aa95-ce450e496f80 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090497 Aug 31 12:27:53.651848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 675/1373] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:54.460670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:54.464647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:54.476526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:54.477347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:54.478086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:54.479344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:54.480325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:54.481191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:54.544496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a81f9e7-6c80-43d2-bb12-d138dd088ff7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091039 Aug 31 12:27:54.545638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 699/1374] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:54.556151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:54.559797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:54.571709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:54.572327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:54.572848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:54.573767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:54.574476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:54.575068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:54.578344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:54.618931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2a97d54b-ae94-4147-a6aa-1b50968fd4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069568 Aug 31 12:27:54.619775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 676/1375] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:54.664691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:54.667089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:54.674115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:54.674712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:54.675266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:54.676147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:54.676663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:54.677132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:54.717228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b174ca3f-6fa2-46b9-a2de-f19130ddfcdb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055388 Aug 31 12:27:54.721865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 700/1376] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:55.561818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:55.564392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:55.580124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:55.580925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:55.581712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:55.582811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:55.583381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:55.583866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:55.625953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-56f03956-dfe1-4621-988d-8838bed26141 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069685 Aug 31 12:27:55.626817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 677/1377] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:55.636901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:55.640561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:55.649440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:55.650080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:55.650617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:55.651503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:55.652061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:55.652576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:55.704492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea898391-143a-4a2b-8e8c-ac9034d2f74a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074499 Aug 31 12:27:55.705733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 701/1378] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:55.730596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:55.734507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:55.749428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:55.750095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:55.750726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:55.751568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:55.752180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:55.753533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:55.791515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-76d2fdcc-5d7a-490d-951c-049fbdb44953 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065574 Aug 31 12:27:55.792409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 678/1379] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:56.645649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:56.649800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:56.664686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:56.665619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:56.667974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:56.668845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:56.669325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:56.669759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:56.712776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07be8e2e-7fef-42d7-9917-40f48fd6e87f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074826 Aug 31 12:27:56.713440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 702/1380] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:56.722455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:56.725288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:56.733880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:56.734469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:56.735051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:56.735976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:56.736959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:56.738250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:56.780688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8fe73012-d71f-45ec-8289-d47c4cbb2c77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062962 Aug 31 12:27:56.781375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 679/1381] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:56.805210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:56.808252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:56.817038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:56.817468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:56.817771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:56.818518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:56.819012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:56.819499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:56.867744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b305310-4eae-43e7-a8c6-7dfd6ec35faa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066023 Aug 31 12:27:56.869054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 703/1382] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:57.730194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:57.735107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:57.746802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:57.747593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:57.748361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:57.749338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:57.750022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:57.750657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:57.799729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:57.803452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:57.807897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e16e3fd5-8443-4061-85cd-273636d1b708 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084277 Aug 31 12:27:57.809032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 680/1383] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:27:57.813847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:57.814335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:57.814853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:57.815882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:57.816391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:57.816851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:57.868505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-799ac0b2-fddd-4e26-9065-52b239e90d1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077346 Aug 31 12:27:57.869106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 704/1384] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:57.882468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:57.884800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:57.892013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:57.892601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:57.893218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:57.893847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:57.894154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:57.894575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:57.937584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28796d4b-4f55-4170-a174-286ee075b9d5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059222 Aug 31 12:27:57.938149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 681/1385] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:58.822218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:58.824570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:58.833436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:58.834235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:58.834772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:58.835700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:58.836250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:58.836771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:58.876025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8d8c617c-3c03-43b4-a744-3b7ee03ce64d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057965 Aug 31 12:27:58.876885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 705/1386] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:58.889758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:58.893948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:58.905031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:58.905785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:58.906511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:58.907951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:58.908713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:58.909452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:58.954921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:58.958745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:58.968792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:58.969687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:58.970512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:58.971944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:58.972809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:58.973524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:58.974650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5009c373-0185-4b99-94ee-f8647baeed2f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091420 Aug 31 12:27:58.975725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 682/1387] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:27:59.030722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04d6483d-8e40-4a72-8f39-548d8b69efe0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083121 Aug 31 12:27:59.031345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 706/1388] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:27:59.896095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:59.900131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:27:59.904116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=88 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:59.915089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:59.916016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:59.916926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:59.918005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:27:59.918802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:27:59.919529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:27:59.976082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8119884e-74d3-4202-9a4b-46f0116c9077 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088780 Aug 31 12:27:59.977152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 683/1389] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:27:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:27:59.992228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:27:59.995088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:00.009861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:00.010556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:00.011179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:00.012171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:00.012690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:00.013164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:00.051494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:00.055572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:00.062766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fdd0b6e8-9994-4da4-be66-4abfa508da69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076446 Aug 31 12:28:00.063579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 707/1390] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:27:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:00.066911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:00.067790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:00.068615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:00.069942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:00.070818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:00.071664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:00.122655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-685558e8-4149-4a65-bb3f-4ee67ea21047 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078969 Aug 31 12:28:00.123302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 684/1391] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:00.995913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:00.998942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:01.008108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:01.008677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:01.009167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:01.010057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:01.010692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:01.011210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:01.058062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2621369-9f5b-4fe3-9763-61d12e8afb10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067954 Aug 31 12:28:01.059062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 708/1392] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:01.077072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:01.079411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:01.089566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:01.090081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:01.090525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:01.091271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:01.091836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:01.092353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:01.133227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e51864b6-f96e-4637-b3bc-76e52a4f2dfe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060423 Aug 31 12:28:01.133925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 685/1393] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:01.137602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:01.140227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:01.148265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:01.148577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:01.149029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:01.149750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:01.150201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:01.150623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:01.193743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-256bd449-96bd-4c02-accb-4c66c7b0d870 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060949 Aug 31 12:28:01.194531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 709/1394] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:02.076092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:02.078728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:02.086953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:02.087734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:02.088298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:02.089162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:02.089675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:02.090161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:02.142599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c928efb-9e7c-49d5-858e-ec58dc6e42fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071456 Aug 31 12:28:02.143467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 686/1395] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:02.153534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:02.157823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:02.170187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:02.171373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:02.172238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:02.173526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:02.174420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:02.175228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:02.211908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:02.215998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:02.228349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:02.229481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:02.230882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:02.232205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:02.233953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:02.234826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:02.251783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9aebe990-7692-4f87-9dbe-c9a80991f48b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106482 Aug 31 12:28:02.253121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 710/1396] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:02.307337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0325c3e-b470-4586-81e2-86dfd3f2f477 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103519 Aug 31 12:28:02.308379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 687/1397] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:03.158193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:03.161663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:03.172692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:03.173472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:03.174163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:03.175506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:03.176309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:03.176999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:03.229449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5640daec-f297-45ca-91b6-033b93dba8c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076448 Aug 31 12:28:03.230041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 711/1398] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:03.269511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:03.272334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:03.280636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:03.281306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:03.282290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:03.284140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:03.284833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:03.285492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:03.326876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:03.330879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:03.341669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:03.342593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-268aacc8-9904-4ae5-bdb4-485158ca7426 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077291 Aug 31 12:28:03.342804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:03.343503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:03.343982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 688/1399] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:03.344719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:03.345571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:03.346368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:03.406507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44133bdf-dd87-4c58-a6df-8abceefc91b4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087034 Aug 31 12:28:03.407898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 712/1400] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:04.247746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:04.250517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:04.258664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:04.259165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:04.259642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:04.260390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:04.260853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:04.261306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:04.321009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d0c7064-81b7-4758-b43a-39a407fb5b83 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078074 Aug 31 12:28:04.322072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 689/1401] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:04.363979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:04.368070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:04.380270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:04.381133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:04.381865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:04.383106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:04.383975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:04.384697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:04.404922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:04.425752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:04.429504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:04.431313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff1ca455-ca90-4abd-b4da-a44b02ec6787 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074859 Aug 31 12:28:04.432337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 713/1402] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:04.440383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:04.441237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:04.441958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:04.443160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:04.443953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:04.444658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:04.501500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e52e8965-5f68-4e67-98a1-c605ad222ab8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082036 Aug 31 12:28:04.502321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 690/1403] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:05.337406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:05.339956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:05.347526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:05.348015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:05.348539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:05.349264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:05.349698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:05.350115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:05.404082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c9456c6-9219-4dcc-886f-80eb6d3637fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070698 Aug 31 12:28:05.404889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 714/1404] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:05.450396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:05.453072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:05.461683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:05.462319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:05.462853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:05.463923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:05.464486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:05.465003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:05.521248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:05.522939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e25b7e05-c4f6-4b98-bc0d-051db7ad83f6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076692 Aug 31 12:28:05.523982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 691/1405] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:05.524450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:05.531484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:05.531959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:05.532682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:05.533658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:05.533901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:05.534279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:05.586014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12d9373a-c11b-4740-9f4b-800c3d04a8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072649 Aug 31 12:28:05.586975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 715/1406] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:06.423894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:06.426899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:06.439705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:06.440528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:06.441258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:06.442515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:06.443271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:06.443975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:06.490665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:06.503401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89b85d9d-c637-49c6-b02b-01b1b991d01b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085555 Aug 31 12:28:06.504474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 692/1407] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:06.542398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:06.546095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:06.554569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:06.555064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:06.555532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:06.556737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:06.557338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:06.558017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:06.613531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-531d0785-3edf-430a-bcbd-97dd3f8f3b5d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077739 Aug 31 12:28:06.613947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:06.614939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 716/1408] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:06.617577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:06.629466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:06.630353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:06.631136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:06.632456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:06.633833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:06.634067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:06.694915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6aa74261-d5e6-4b52-999c-445839dbeec5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089419 Aug 31 12:28:06.695844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 693/1409] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:07.520207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:07.522507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:07.530214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:07.530820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:07.531262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:07.532114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:07.534245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:07.534890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:07.577353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bbc661ac-906a-42b9-94f1-2ec83292e851 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062578 Aug 31 12:28:07.585191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 717/1410] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:07.631700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:07.634251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:07.642300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:07.643269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:07.643891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:07.644633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:07.645090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:07.645536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:07.692229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f051e1ce-2d80-4167-b9d5-7518304bd098 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064717 Aug 31 12:28:07.692933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 694/1411] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:07.711887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:07.714522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:07.722827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:07.723607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:07.724291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:07.725412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:07.726185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:07.726894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:07.772485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b281b1a2-ab1c-4d88-abd1-65af726caf5a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064475 Aug 31 12:28:07.773550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 718/1412] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:08.595117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:08.597577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:08.609955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:08.610624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:08.611464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:08.612534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:08.613108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:08.613645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:08.672899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad65fcf0-8583-4140-8105-5a6bc9a8fb6c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081653 Aug 31 12:28:08.674436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 695/1413] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:08.709526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:08.713372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:08.726057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:08.726902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:08.727699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:08.728984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:08.729801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:08.730545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:08.789093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:08.790621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1fa35eb3-2168-44f7-a383-897c1838ee36 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088610 Aug 31 12:28:08.791663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 719/1414] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:08.791989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:08.798879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:08.799397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:08.799827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:08.800553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:08.801003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:08.801418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:08.837997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5dd0c00a-93ee-4abe-9632-4bc98d9d9492 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052879 Aug 31 12:28:08.838994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 696/1415] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:09.693866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:09.697735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:09.709652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:09.710571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:09.711267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:09.712587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:09.713405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:09.714165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:09.773951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73161a2e-dd74-40e1-a71f-13d5d99bebd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087316 Aug 31 12:28:09.774965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 720/1416] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:09.807842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:09.811621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:09.822964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:09.823852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:09.824583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:09.825715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:09.826468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:09.827179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:09.855371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:09.859023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:09.866997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:09.867632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:09.868067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:09.868791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:09.869230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:09.869652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:09.886482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c44d38f6-0849-4b84-b8f3-564f8ffa4866 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083034 Aug 31 12:28:09.887503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 697/1417] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:09.911553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41206c9f-a785-4dc6-a2c4-94bd2710d136 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064557 Aug 31 12:28:09.912165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 721/1418] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:10.793785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:10.797154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:10.807330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:10.808031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:10.808816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:10.809917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:10.810603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:10.811342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:10.868442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28f49545-71e2-4f60-ac80-976490a6fb5e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081107 Aug 31 12:28:10.869524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 698/1419] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:10.904927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:10.909146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:10.921164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:10.922051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:10.922818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:10.924157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:10.924982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:10.925727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:10.927829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:10.930649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:10.939441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:10.940084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:10.940621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:10.941462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:10.942059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:10.942741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:10.979724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5e2be03d-cd56-47bb-95fb-00272b95f43e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057082 Aug 31 12:28:10.980500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 699/1420] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:10.986745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-671c894a-45b0-4553-98f0-d66c90c62dfb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088507 Aug 31 12:28:10.987863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 722/1421] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:11.887477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:11.890973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:11.901999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:11.902740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:11.903431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:11.904542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:11.905242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:11.905877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:11.956410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fbc32fc2-bd45-487e-9dc9-a81a4ae0c126 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075233 Aug 31 12:28:11.957276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 700/1422] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:11.994969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:12.000057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:12.006563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:12.009740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:12.012958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:12.013818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:12.014597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:12.015885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:12.016712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:12.017613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:12.019993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:12.020787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:12.021552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:12.022812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:12.023642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:12.024346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:12.070495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fa2ee4d6-459f-4bf4-bee8-22fe1fb21b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071207 Aug 31 12:28:12.071563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 701/1423] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:12.078034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e89cb0e-12f8-42ed-b463-ed2eeabc390e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087012 Aug 31 12:28:12.079048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 723/1424] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:12.972600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:12.975261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:12.984499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:12.985271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:12.986030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:12.987142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:12.987889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:12.988557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:13.040234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a97d7d8-0810-4911-aa2d-1b7fa8f4e6b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072578 Aug 31 12:28:13.041057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 702/1425] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:13.085922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:13.089093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:13.092216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=82 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:13.094259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:13.096654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:13.100222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:13.100746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:13.101224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:13.101952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:13.102419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:13.102844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:13.103679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:13.104171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:13.104605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:13.105317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:13.105768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:13.106232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:13.144647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-82d8b41f-d006-4281-a7c8-74c48a660701 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055694 Aug 31 12:28:13.145359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 703/1426] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:13.145840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9df8d75-c78d-4c33-9546-a25db2c8f392 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064797 Aug 31 12:28:13.146424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 724/1427] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:14.056767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:14.059198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:14.067731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:14.068364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:14.068897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:14.069704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:14.070251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:14.070996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:14.107026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-783f4122-a40d-4a1c-bf74-f7712f3aacd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054774 Aug 31 12:28:14.107655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 704/1428] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:14.159751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:14.160249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:14.162625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:14.163107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:14.170791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:14.171197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:14.171593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:14.171965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:14.172251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:14.172643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:14.173515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:14.174109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:14.174593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:14.174774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:14.175205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:14.175850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:14.220570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89173ec3-4bdc-4a87-a618-cd9719c7b20f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066007 Aug 31 12:28:14.221587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 705/1429] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:14.223928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a5c491b8-5401-47da-a9cd-c73878fcbfa9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069702 Aug 31 12:28:14.224749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 725/1430] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:15.124182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:15.128692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:15.140681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:15.141550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:15.142342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:15.143630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:15.144425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:15.145106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:15.208269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-731a4204-67bc-40b2-922f-7641aec1cfcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090786 Aug 31 12:28:15.209353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 706/1431] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:15.237685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:15.238381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:15.240076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:15.240294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:15.248501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:15.249008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:15.249247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:15.249646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:15.249849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:15.250116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:15.250776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:15.251441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:15.252195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:15.252386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:15.252867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:15.253076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:15.292257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c931818-84b3-40f8-99a3-5cc56df14f74 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059458 Aug 31 12:28:15.293180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 726/1432] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:15.304610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22f83d49-696d-4a33-bab3-8069e9d11e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070537 Aug 31 12:28:15.305669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 707/1433] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:16.225559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:16.228053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:16.234822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:16.235395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:16.235776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:16.236851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:16.237314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:16.237746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:16.273928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-df86f43d-82cd-4a1f-98f0-c84ab90ea4a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052683 Aug 31 12:28:16.274516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 727/1434] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:16.307897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:16.310370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:16.318612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:16.319105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:16.319560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:16.320306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:16.320760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:16.321165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:16.326742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:16.330825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:16.341588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:16.342462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:16.343220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:16.344467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:16.345202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:16.345864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:16.357750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4f19e91-2756-4b4c-b0cb-7066eda40806 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055318 Aug 31 12:28:16.358327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 708/1435] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:16.408334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-95f741d3-370d-4dae-bf03-b46a49845e34 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088467 Aug 31 12:28:16.409434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 728/1436] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:17.288331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:17.291485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:17.299147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:17.299748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:17.300223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:17.300993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:17.301456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:17.301887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:17.323017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:17.348997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3129c90e-505d-4f30-89a6-3f4ef9101a2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064851 Aug 31 12:28:17.349632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 709/1437] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:17.374060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:17.378038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:17.389232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:17.389716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:17.390144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:17.390842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:17.391320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:17.391766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:17.426189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:17.430191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:17.433370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04b35396-df5e-46f0-b5ea-2bfd1f18072c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065983 Aug 31 12:28:17.434228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 729/1438] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:17.443515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:17.444439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:17.445127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:17.446434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:17.447263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:17.448009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:17.498687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d21cf2e-3cd0-451d-a997-8e343a0e34a0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080081 Aug 31 12:28:17.499468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 710/1439] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:18.363565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:18.365977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:18.373548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:18.374176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:18.375138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:18.375585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:18.376355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:18.377413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:18.380482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:18.416974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b05d586-1429-43f4-abf9-11026c7c73f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058391 Aug 31 12:28:18.417559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 730/1440] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:18.449057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:18.451915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:18.460660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:18.461289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:18.461813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:18.462619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:18.463171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:18.463744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:18.515854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:18.518355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6a70f4a5-823c-4314-a0cb-6f651f0c83d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074062 Aug 31 12:28:18.519410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 711/1441] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:18.520779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:18.528145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:18.528784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:18.529333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:18.530147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:18.530697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:18.531211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:18.573876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70256c00-845d-45a6-8c29-840959f7bf68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063242 Aug 31 12:28:18.575053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 731/1442] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:19.430195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:19.432745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:19.442535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:19.442868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:19.443659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:19.444401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:19.444907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:19.445365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:19.481883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4475999d-d5ca-40b1-934f-c88536dc661d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055654 Aug 31 12:28:19.482941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 712/1443] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:19.534664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:19.536790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:19.544758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:19.545421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:19.545889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:19.546648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:19.547135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:19.547661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:19.588897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0d1afb96-a405-44cc-aece-025f6b9369ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058893 Aug 31 12:28:19.589711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:19.590391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 732/1444] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:19.592878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:19.608511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:19.609013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:19.609442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:19.610148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:19.610882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:19.611519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:19.647909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b5fabf4c-1684-47ec-85e4-9a7ea206ab4c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063153 Aug 31 12:28:19.648682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 713/1445] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:20.498502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:20.500932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:20.508450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:20.508933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:20.509358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:20.510045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:20.510716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:20.511193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:20.549927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d828c68-8361-42e1-bdd0-834d4e52aea0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055378 Aug 31 12:28:20.551165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 733/1446] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:20.607136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:20.612183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:20.624093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:20.624933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:20.625753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:20.627163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:20.628023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:20.628796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:20.664647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:20.666433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:20.676443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:20.678032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:20.678934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:20.680258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:20.681115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:20.681595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eabbc106-6b53-4396-90a0-1aa79d9e5d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082647 Aug 31 12:28:20.681874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:20.682570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 714/1447] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:20.746436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6771c194-c600-4b6a-bdce-3373da4f6949 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087673 Aug 31 12:28:20.747876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 734/1448] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:21.564780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:21.568386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:21.577425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:21.577917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:21.578348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:21.579133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:21.579940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:21.580056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:21.625175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6c055a68-ce39-48d1-965c-484e791faf7d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064500 Aug 31 12:28:21.627351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 715/1449] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:21.697965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:21.701199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:21.710108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:21.710915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:21.711518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:21.712466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:21.713062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:21.713598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:21.750770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26999db8-c302-4cd1-acfa-1524fcae959a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057535 Aug 31 12:28:21.751487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 735/1450] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:21.762086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:21.764734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:21.772669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:21.773236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:21.773689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:21.774427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:21.774917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:21.775374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:21.836701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e86d3dfc-7a0d-4c77-abad-2f571f1bc2cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078817 Aug 31 12:28:21.837629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 716/1451] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:22.641863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:22.645613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:22.655901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:22.656795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:22.657768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:22.658524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:22.659076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:22.659619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:22.708948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7852309a-ee1f-4eed-b4d5-80200ffd06b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072674 Aug 31 12:28:22.710219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 736/1452] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:22.769060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:22.772921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:22.786405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:22.787269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:22.788046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:22.789398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:22.790203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:22.790981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:22.852025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:22.854691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:22.863046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:22.863957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:22.864680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:22.866021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:22.866492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4514bb6f-b0c2-4969-92b0-0b9ec61d9b91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104505 Aug 31 12:28:22.866681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:22.867099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:22.867566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 717/1453] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:22.933477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-936c09b5-8c1c-4177-8b00-2eaa846dc0d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085812 Aug 31 12:28:22.934655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 737/1454] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:23.731051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:23.735951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:23.747564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:23.748260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:23.748791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:23.749700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:23.750233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:23.750864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:23.793501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8fb3ba5-e92e-431b-8661-ff5a00bb14b9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069669 Aug 31 12:28:23.794723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 718/1455] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:23.881897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:23.884658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:23.893449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:23.893949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:23.894403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:23.895136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:23.895758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:23.896180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:23.935173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5311e76-242c-4146-addf-646a3498d4ca tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058243 Aug 31 12:28:23.935791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 738/1456] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:23.949613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:23.956640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:23.960881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:23.961416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:23.961897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:23.962671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:23.963183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:23.963851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:24.023092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b1cc12a5-5384-42d1-9318-f213838391b2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077685 Aug 31 12:28:24.024089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 719/1457] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:24.808668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:24.811159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:24.818400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:24.818913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:24.819478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:24.820287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:24.820775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:24.821208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:24.863396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c30e9e48-64f6-4cc2-9d3c-96934b239501 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060382 Aug 31 12:28:24.863987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 739/1458] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:24.950498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:24.952755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:24.960847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:24.961475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:24.962021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:24.962833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:24.963421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:24.963932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:25.005269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02504fa0-7592-42e8-840b-2f4d39cf3867 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059875 Aug 31 12:28:25.005934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 720/1459] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:25.040217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:25.042840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:25.050349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:25.050836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:25.051291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:25.052017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:25.052464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:25.052878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:25.093775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4218926-5bb7-4882-82bc-648320fdd906 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057981 Aug 31 12:28:25.094751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 740/1460] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:25.881147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:25.883918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:25.891122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:25.892221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:25.892798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:25.893646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:25.894235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:25.894776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:25.931380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f25378fc-fd8a-452e-a2ee-bcac0e721d69 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058759 Aug 31 12:28:25.931988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 721/1461] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:26.019643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:26.021836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:26.029513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:26.030276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:26.030977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:26.032429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:26.033234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:26.033920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:26.074950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d558197e-f4ef-47d9-a3b4-0525e5a0804f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060076 Aug 31 12:28:26.075988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 741/1462] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:26.110591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:26.114109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:26.125722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:26.126282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:26.126771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:26.127544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:26.127995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:26.128413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:26.168302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c6a70ab-4667-40e1-8414-566edd33623e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062486 Aug 31 12:28:26.168823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 722/1463] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:26.944543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:26.946944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:26.953624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:26.954446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:26.954928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:26.955713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:26.956165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:26.956579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:26.992941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d44def0b-e939-4875-81fd-95523666934d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052582 Aug 31 12:28:26.993630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 742/1464] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:27.089301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:27.091618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:27.098287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:27.098913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:27.099474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:27.100288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:27.100746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:27.101416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:27.136929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f32e2ee-19f7-484e-8fbe-47db36bdfa04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052069 Aug 31 12:28:27.137691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 723/1465] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:27.182809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:27.185180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:27.193169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:27.193959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:27.194661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:27.195875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:27.196625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:27.197329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:27.233979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70dd9edc-bddf-49c2-b03f-fec67fe6fa24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055624 Aug 31 12:28:27.234737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 743/1466] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:28.009952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:28.012609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:28.021774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:28.022461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:28.022943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:28.023784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:28.024277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:28.024750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:28.087378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6cc9c41b-c7d9-4050-9e4d-468956bfcb46 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081901 Aug 31 12:28:28.088443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 724/1467] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:28.151149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:28.153321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:28.161303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:28.161927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:28.162432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:28.163200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:28.163804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:28.164318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:28.206252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d2f3d6ff-3614-4e4a-b859-e029490d60f9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059949 Aug 31 12:28:28.207110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 744/1468] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:28.252199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:28.254622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:28.262787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:28.263340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:28.263881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:28.264843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:28.265357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:28.265780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:28.307073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c887bde-d9af-492b-b2e4-481f1b766ab0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059022 Aug 31 12:28:28.307831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 725/1469] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:29.109819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:29.114207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:29.127173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:29.128294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:29.129052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:29.130204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:29.131040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:29.131837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:29.181281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-812228c5-85e6-47d7-9680-e4407588b5d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079928 Aug 31 12:28:29.181917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 745/1470] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:29.220586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:29.222911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:29.230274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:29.230837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:29.231521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:29.232318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:29.232781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:29.233304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:29.236157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:29.274112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6cf5cc97-7a4f-44c2-b148-f2b2923fe735 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058706 Aug 31 12:28:29.275343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 726/1471] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:29.321937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:29.324808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:29.333339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:29.333878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:29.334362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:29.335126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:29.335638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:29.336121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:29.367569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:29.376006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea5f59f4-0b0a-463b-b889-670a17b79c47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058767 Aug 31 12:28:29.376681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 746/1472] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:30.195200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:30.197470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:30.199932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=88 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:30.207417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:30.207955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:30.208422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:30.209147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:30.209593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:30.210008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:30.250239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15fe4546-854d-475c-afac-b52f490df39e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059278 Aug 31 12:28:30.251356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 727/1473] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:30.289837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:30.292410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:30.299807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:30.300315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:30.300757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:30.301499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:30.301957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:30.302385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:30.339831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0cd5326-3878-4fcc-b70f-26d9a86f0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056105 Aug 31 12:28:30.340930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 747/1474] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:30.394183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:30.397968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:30.409395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:30.410259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:30.411013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:30.412282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:30.413203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:30.413915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:30.457936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-07229642-d32e-4f7f-a877-47775fbf7a15 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071198 Aug 31 12:28:30.458411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 728/1475] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:31.265217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:31.274006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:31.283038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:31.284089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:31.284810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:31.286061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:31.286854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:31.287644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:31.350812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18e09474-baf0-48e4-a278-e7754399e1e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090271 Aug 31 12:28:31.352293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 748/1476] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:31.356514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:31.359034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:31.366862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:31.367542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:31.368087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:31.369028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:31.369600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:31.370120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:31.407892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-767c2e19-1751-4e5d-9d58-8f62f17fdf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056782 Aug 31 12:28:31.408686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 729/1477] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:31.473382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:31.475925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:31.484162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:31.485040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:31.487426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:31.488339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:31.488871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:31.489388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:31.532819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-864223a3-a018-41f1-a845-e551f7d05666 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063660 Aug 31 12:28:31.533832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 749/1478] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:32.370272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:32.372914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:32.379719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:32.380215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:32.380652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:32.381353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:32.381804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:32.382222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:32.424628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:32.427531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:32.434199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fdeba9c8-a541-43ee-9376-0d9dd4dec364 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067749 Aug 31 12:28:32.439732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 730/1479] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:32.440035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:32.440035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:32.440035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:32.440035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:32.440494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:32.440494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:32.473147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b2f1ae61-c5c7-4dc2-baf6-8b4c8d1f995b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056039 Aug 31 12:28:32.473712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 750/1480] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:32.547027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:32.552146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:32.564486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:32.565334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:32.566089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:32.567362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:32.568140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:32.568878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:32.627403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-76e1f496-7054-4d2f-8299-3ad8383cc16a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084723 Aug 31 12:28:32.628523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 731/1481] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:33.448461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:33.451224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:33.460524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:33.461367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:33.462083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:33.463103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:33.463602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:33.464031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:33.496095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:33.505074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:33.520241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12ebac09-e720-40d4-a2d4-4f99625ba81b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075752 Aug 31 12:28:33.521626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 751/1482] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:33.521850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:33.522529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:33.523322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:33.524600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:33.525389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:33.526194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:33.586366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-968eaa0d-0065-411c-bac7-b33fb586b424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099380 Aug 31 12:28:33.587477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 732/1483] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:33.647435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:33.650092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:33.664954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:33.665803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:33.666540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:33.667702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:33.668188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:33.668677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:33.727306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e07211e9-606d-41d8-a53e-81a4ae055c24 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086059 Aug 31 12:28:33.728133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 752/1484] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:34.544586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:34.549457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:34.562337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:34.563208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:34.564216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:34.565510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:34.566355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:34.567101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:34.601740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:34.604880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:34.613739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:34.614399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:34.614985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:34.616088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:34.616624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:34.617296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:34.634635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-79182116-053a-491f-a36e-fc8d830bfefc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098570 Aug 31 12:28:34.636009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 733/1485] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:34.671579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c80faeb5-ca1a-45f8-888c-ab66482cb08b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073958 Aug 31 12:28:34.673187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 753/1486] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:34.747820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:34.751916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:34.759656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:34.760146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:34.760630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:34.761345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:34.761807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:34.762229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:34.808729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4dd3f3e8-31aa-4efe-a0d5-24f15e5d89e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070463 Aug 31 12:28:34.809667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 734/1487] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:35.651386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:35.653785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:35.661738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:35.662234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:35.662690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:35.663454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:35.663918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:35.664361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:35.692107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:35.695541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:35.706577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:35.707466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:35.708189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:35.709112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:35.709841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:35.710509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:35.721477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c220a2f-f59a-481a-8786-d3a6ec879b1c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074054 Aug 31 12:28:35.722422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 754/1488] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:35.760557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ed1d4f52-9cb6-46e1-81e0-59c10a782253 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073839 Aug 31 12:28:35.761645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 735/1489] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:35.823586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:35.826887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:35.836168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:35.836795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:35.837346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:35.838250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:35.838803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:35.839376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:35.878592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2eafcaa7-10f3-4ca8-acdb-1a9c08234a0e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059842 Aug 31 12:28:35.879560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 755/1490] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:36.782758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:36.786750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:36.799297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:36.800199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:36.800926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:36.802258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:36.803093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:36.803900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:36.849328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b2907e4f-9547-4d80-9a0b-ca9d8943ad49 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074989 Aug 31 12:28:36.850140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 756/1491] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:36.883298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:36.885722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:36.893706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:36.896306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:36.900536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:36.901449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:36.902304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:36.903681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:36.904219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:36.904712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:36.904924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:36.905239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:36.905643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:36.906118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:36.906595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:36.907519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:36.948187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f373c9d-fe36-47a7-97b9-64749f1bb4b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059202 Aug 31 12:28:36.948929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 757/1492] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:36.969409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33e8c1c7-8793-4a2a-b00e-e2563a6b4e79 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.236943 Aug 31 12:28:36.970458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 736/1493] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:37.867669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:37.871632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:37.884214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:37.885353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:37.886128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:37.887503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:37.888273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:37.888988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:37.950226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6640b7d5-95e4-4f18-96c1-57b17780be54 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089436 Aug 31 12:28:37.951639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 758/1494] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:37.969051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:37.973048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:37.985860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:37.986654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:37.987470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:37.988720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:37.989481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:37.990212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:37.992539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:37.996239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:38.007327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:38.008163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:38.008904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:38.009980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:38.010815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:38.011618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:38.054070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-034a5013-01bd-4ae0-9b5c-b262b862c62c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091969 Aug 31 12:28:38.055593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 737/1495] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:38.073017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4521b78a-1330-40b5-85cc-5e551de3d29c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088809 Aug 31 12:28:38.073907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 759/1496] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:38.967330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:38.969767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:38.972997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:28:38.973288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments (ip 10.222.0.27) !!! Aug 31 12:28:38.981517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:38.982201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:38.982792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:38.983644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:38.984212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:38.984903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:39.027851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84ea4773-c354-4d66-9b9c-3f49b0d385c0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065118 Aug 31 12:28:39.028782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 738/1497] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:39.079105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:39.083540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:39.091829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:39.095504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:39.103481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:39.103982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:39.104430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:39.105331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:39.105797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:39.106318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:39.108444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:39.109088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:39.111092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:39.113931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:39.113931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:39.113931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:39.149153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-60d913c7-735a-47d8-a5f5-4125c6a275a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062331 Aug 31 12:28:39.149639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 739/1498] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:39.167161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40cdb1a5-2c6e-4215-bdc8-02263d06a00f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095094 Aug 31 12:28:39.167826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 760/1499] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:40.050439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:40.053646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:40.066519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:40.067380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:40.068051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:40.069291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:40.070070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:40.070720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:40.113585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-603f0299-fd2f-4e49-b001-db3a88eedbef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072166 Aug 31 12:28:40.114416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 740/1500] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:40.163897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:40.166188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:40.173826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:40.174314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:40.174745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:40.175570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:40.176020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:40.176435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:40.184549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:40.188503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:40.198995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:40.200494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:40.200662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:40.201704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:40.202473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:40.203224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:40.225414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d1f2dbb-26b5-40e3-a8ee-0fb02e2a3cf6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066042 Aug 31 12:28:40.225999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 761/1501] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:40.255368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc113036-ccf6-45e4-b942-91420c7e92da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078067 Aug 31 12:28:40.256191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 741/1502] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:41.132995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:41.136513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:41.146865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:41.147843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:41.148366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:41.149324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:41.150150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:41.150916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:41.207568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f6db831-a588-47aa-9446-eff0320da08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082413 Aug 31 12:28:41.208741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 762/1503] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:41.244345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:41.248405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:41.261387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:41.262277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:41.263092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:41.264339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:41.265170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:41.266013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:41.271411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:41.274906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:41.283532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:41.284185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:41.284723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:41.285558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:41.286156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:41.286672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:41.306951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:41.317435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:41.328768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-394d2494-5219-499d-8b4d-bafb5e346f45 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092282 Aug 31 12:28:41.329787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 742/1504] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:41.333753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6b9d12d-bb7e-4955-8651-bafc7ab242f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068390 Aug 31 12:28:41.334909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 763/1505] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:42.226009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:42.229776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:42.241480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:42.242313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:42.243119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:42.244399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:42.245415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:42.245819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:42.306432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d3dddb5f-8fa6-439c-8ff4-05fd7f85356f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087378 Aug 31 12:28:42.307366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 743/1506] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:42.348525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:42.349433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:42.351159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:42.351937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:42.359483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:42.359832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:42.360046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:42.360307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:42.360646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:42.360891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:42.361452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:42.361649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:42.362069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:42.362379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:42.362717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:42.363019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:42.403487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a87b4a25-f93e-4c30-9f5b-43151b95debd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059180 Aug 31 12:28:42.404273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 744/1507] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:42.405671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4afc63ca-0d8e-48da-a4a9-b7cdacca2742 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063544 Aug 31 12:28:42.407062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 764/1508] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:43.324690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:43.327977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:43.338932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:43.339468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:43.339916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:43.341093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:43.341936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:43.342670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:43.385672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2b9b4c2-dec1-494a-97ab-08c52ae74e46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067304 Aug 31 12:28:43.386252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 745/1509] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:43.420516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:43.421265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:43.424223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:43.424783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:43.430202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=82 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:43.431490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:43.432025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:43.432425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:43.433177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:43.433638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:43.434049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:43.436898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:43.437654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:43.438416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:43.439593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:43.440305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:43.441022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:43.476362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25d5a0ec-a2ac-45f2-a62c-a330ffab4c45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060543 Aug 31 12:28:43.477114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 746/1510] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:43.485815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-32e5efbe-ccb8-4988-95db-2a2b8fc0a0e7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070989 Aug 31 12:28:43.486400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 765/1511] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:44.404630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:44.408978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:44.421126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:44.421991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:44.422721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:44.423988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:44.424501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:44.425167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:44.479425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2184b1b1-eeeb-4dc1-9fcb-6c11f9d8b7a9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081723 Aug 31 12:28:44.480513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 747/1512] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:44.499009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:44.502473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:44.502764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:44.505782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:44.512638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:44.513199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:44.513784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:44.514661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:44.515038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:44.515621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:44.515844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:44.516369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:44.516852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:44.517644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:44.518477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:44.519289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:44.562855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e60a2c11-48f5-432a-9d2f-eb4abfe91af5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067190 Aug 31 12:28:44.564532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 748/1513] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:44.574454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0d061e57-7a1f-4e95-a462-c58142e55e4e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082805 Aug 31 12:28:44.575486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 766/1514] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:45.496926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:45.499676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:45.507435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:45.508089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:45.508623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:45.509458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:45.510016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:45.510537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:45.548344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-abbfef04-720b-4264-8cf3-e2e7a33c001a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056382 Aug 31 12:28:45.548952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 749/1515] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:45.578328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:45.580804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:45.588292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:45.588784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:45.589221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:45.589926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:45.590376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:45.590798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:45.597539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:45.601019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:45.612403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:45.613302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:45.614012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:45.615224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:45.616044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:45.616803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:45.632427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f18aeb6c-d1c0-4c30-846c-404b31a7f751 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058502 Aug 31 12:28:45.633335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 767/1516] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:45.679423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3301c29e-11b1-4d29-87a0-69474a8c3825 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093173 Aug 31 12:28:45.680175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 750/1517] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:46.562390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:46.566083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:46.573629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:46.574115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:46.574532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:46.575312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:46.575920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:46.576477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:46.622130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4c0825b-f402-4779-80cf-8b00fc5699af tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064082 Aug 31 12:28:46.628650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 768/1518] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:46.651343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:46.655632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:46.673530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:46.674406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:46.675178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:46.676484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:46.677313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:46.678064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:46.698187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:46.702448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:46.712279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:46.713688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:46.714456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:46.715747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:46.716645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:46.717536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:46.751031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-00f6c04f-229e-442b-a5f6-839e6103c675 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106716 Aug 31 12:28:46.753064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 751/1519] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:28:46.793051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b18ae03-f4c8-42ab-ac7d-0340a1b0fa60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100665 Aug 31 12:28:46.793973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 769/1520] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:47.640122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:47.643462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:47.652989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:47.653997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:47.653997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:47.654708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:47.655258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:47.655694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:47.701154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6e3be310-e9d5-49f8-a0d6-288ca38c7fc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066902 Aug 31 12:28:47.702103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 752/1521] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:47.773068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:47.777319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:47.786552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:47.787103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:47.787626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:47.788459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:47.788958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:47.789428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:47.809582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:47.813188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:47.821280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:47.821773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:47.822418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:47.823213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:47.824202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:47.824811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:47.836565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9574f450-61c8-4458-93d3-cbfcf39740e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073080 Aug 31 12:28:47.838850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 770/1522] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:47.868142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ecaad56a-4019-41d5-a404-7cd144414044 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063214 Aug 31 12:28:47.868768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 753/1523] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:48.720826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:48.724767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:48.737747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:48.738632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:48.739468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:48.740790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:48.741632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:48.742412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:48.804713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b1a8bff-08d4-44df-b360-2a062bd3fcb9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091121 Aug 31 12:28:48.805698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 771/1524] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:48.851329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:48.853587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:48.856576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:28:48.856782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments (ip 10.222.0.27) !!! Aug 31 12:28:48.865055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:48.865569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:48.866002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:48.866700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:48.867388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:48.867813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:48.884815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:48.888094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:48.896133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:48.896631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:48.897064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:48.897962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:48.898479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:48.898900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:48.917601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b4aec8a-db1d-4381-9081-5dbc8f6a3fc7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070490 Aug 31 12:28:48.918446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 754/1525] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:48.939057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0a2909d-e013-409f-9c0f-0543a3fe9ef7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058666 Aug 31 12:28:48.939712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 772/1526] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:49.823432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:49.827454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:49.839193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.840027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.840731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.841911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.842697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.843480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.903075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d6f5ee3e-b59b-4e81-9724-c68936c4687e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087018 Aug 31 12:28:49.904145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 755/1527] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:49.938495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:49.941021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:49.949898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.950519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.951075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.952676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.953797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.954060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:49.954548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.956545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:49.963510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.963995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.964422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.966055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:49.966055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:49.966055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:49.996453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bfbcef35-2758-411b-830f-b1dbb75e8b8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065602 Aug 31 12:28:49.997039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 773/1528] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:50.018871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-52532c6e-b02a-4c69-817e-998709d2b726 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069417 Aug 31 12:28:50.019979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 756/1529] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:50.920142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:50.923703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:50.934134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:50.934809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:50.935214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:50.936219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:50.936795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:50.937684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:50.977696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ab951e2a-e338-45a9-b094-613ffc6e3724 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062216 Aug 31 12:28:50.979290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 774/1530] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:51.010966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:51.014322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:51.025988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:51.026450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:51.026886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:51.027679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:51.028130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:51.028553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:51.082387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6bda9e8c-b9ee-460c-84a5-8f7a8dffacb8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076085 Aug 31 12:28:51.083483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 757/1531] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:51.137803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:51.140344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:51.148641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:51.149262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:51.149808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:51.150634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:51.151181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:51.151786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:51.193330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c5b6172-14ce-4a0a-baad-0203ec4ecf84 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162106 Aug 31 12:28:51.193941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 775/1532] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:51.998116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:52.001578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:52.012114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:52.012971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:52.013686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:52.014612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:52.015217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:52.015678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:52.060019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b7ce4e88-4ea9-4b11-8c38-b9b27216394c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068976 Aug 31 12:28:52.061173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 758/1533] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:52.103559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:52.107395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:52.118574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:52.119524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:52.120234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:52.121524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:52.122323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:52.123261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:52.183021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5c68fbe4-6f8d-4771-8ebe-b00e043293c8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087547 Aug 31 12:28:52.184252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 776/1534] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:52.210474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:52.213584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:52.223797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:52.224512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:52.225000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:52.225913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:52.226454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:52.227067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:52.244886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:52.269031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8eeaa27-90c1-4bb2-91e3-9f1fa65b94f1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065429 Aug 31 12:28:52.269902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 759/1535] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:53.077701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:53.081651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:53.090744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:53.091480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:53.092109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:53.093340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:53.094097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:53.094663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:53.133983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c9388c1-8476-44ac-a3da-1ebcfadf4e61 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062416 Aug 31 12:28:53.134745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 777/1536] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:53.202638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:53.205677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:53.215819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:53.216399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:53.216968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:53.218155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:53.218846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:53.219484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:53.261021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1a64b5ad-4484-4314-8c28-b7a61c89261c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062759 Aug 31 12:28:53.261606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 760/1537] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:53.288071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:53.290390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:53.303225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:53.304184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:53.304990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:53.306271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:53.307094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:53.309175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:53.350695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-38b43cac-34bc-4d34-b884-bdfa84290be5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066950 Aug 31 12:28:53.351699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 778/1538] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:54.147894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:54.150247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:54.159565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:54.160378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:54.161108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:54.162261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:54.162958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:54.163568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:54.202077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-39196c17-8cfa-43e0-914f-ae874280bb25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059038 Aug 31 12:28:54.202730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 761/1539] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:54.278040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:54.282343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:54.286679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:28:54.286961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:28:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments (ip 10.222.0.27) !!! Aug 31 12:28:54.299012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:54.299991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:54.300772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:54.302058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:54.302909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:54.303750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:54.366433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:54.366827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d7a1fdc-f0cb-4294-bae6-fc39711b9b20 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096203 Aug 31 12:28:54.367937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 779/1540] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:54.369903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:54.382318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:54.383374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:54.384143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:54.385703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:54.386639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:54.387378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:54.460164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da8b3555-b4ff-4d50-b9bb-eceba7a2d6b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098286 Aug 31 12:28:54.461102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 762/1541] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:55.218270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:55.221559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:55.231284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:55.232162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:55.232943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:55.234217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:55.235314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:55.236149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:55.244065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:55.297949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-63fbbad1-af1b-4b3d-9aff-acc8a5b4f245 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084472 Aug 31 12:28:55.299427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 780/1542] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:55.386880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:55.390951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:55.399781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:55.400479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:55.401138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:55.402260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:55.403000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:55.403730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:55.445914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b93ff593-2929-4e9b-be07-277a49f236b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065023 Aug 31 12:28:55.446630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 763/1543] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:55.480331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:55.483807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:55.494353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:55.495282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:55.495993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:55.497127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:55.497868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:55.498497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:55.558737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f81d9d2d-9e72-49ec-9980-67ab8d6adb3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086123 Aug 31 12:28:55.564575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 781/1544] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:56.319754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:56.323535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:56.335336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:56.336161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:56.337286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:56.338648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:56.339518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:56.340267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:56.397803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8201050-69d8-4ef7-a236-8eba4216b1ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086458 Aug 31 12:28:56.399004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 764/1545] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:56.461421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:56.464813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:56.474529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:56.475338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:56.476028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:56.476975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:56.477537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:56.478070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:56.521793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54c362ee-f213-4438-a556-578c26fc8411 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065533 Aug 31 12:28:56.522555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 782/1546] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:56.586037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:56.589925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:56.598706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:56.598976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:56.599595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:56.600432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:56.600894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:56.601437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:56.642101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d7c4133-b4f7-4041-8eb2-490089a34f33 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071044 Aug 31 12:28:56.643752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 765/1547] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:57.415938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:57.418907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:57.426857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:57.427544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:57.428089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:57.429036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:57.429604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:57.430146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:57.466637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fe9172c9-d4fa-4688-a2ff-d9256d37fe2a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056926 Aug 31 12:28:57.467673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 783/1548] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:57.539106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:57.542181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:57.551354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:57.552233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:57.552772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:57.553743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:57.554309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:57.554823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:57.616004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc1c9ee5-6c89-4545-9fd1-3adf6722e909 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082923 Aug 31 12:28:57.616996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 766/1549] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:57.657470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:57.660561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:57.672016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:57.672016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:57.672016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:57.672016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:57.676918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:57.676918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:57.734435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f01829fa-875f-4b02-82fb-bdc531f787b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081934 Aug 31 12:28:57.735437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 784/1550] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:58.481617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:58.484545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:58.491291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:58.492030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:58.492689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:58.493580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:58.494196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:58.497946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:58.536820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-00fbf9cc-c18d-43b1-a0b4-9c0be942a977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059896 Aug 31 12:28:58.537895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 767/1551] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:58.637505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:58.641740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:58.651208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:58.651767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:58.652228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:58.653118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:58.653669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:58.654092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:58.694332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3bf1ce06-67d2-4f26-9693-dd7558b74c29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064302 Aug 31 12:28:58.695099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 785/1552] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 31 12:28:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:28:58.753011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:58.755710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:58.766036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:58.766622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:58.767138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:58.768081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:58.768569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:58.769001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:58.818405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f555c67e-c385-4555-b108-1dcf7c52d821 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070910 Aug 31 12:28:58.819094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 768/1553] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:28:59.551482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:59.554651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:59.566916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:59.567832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:59.568589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:59.569867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:59.570633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:59.571416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:59.640195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d59a529-d902-4806-aa2d-86002388f9f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093264 Aug 31 12:28:59.641260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 786/1554] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:28:59.714724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:28:59.718677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:59.729566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:59.730415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:59.731554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:59.733147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:59.733933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:59.734704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:59.777637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR oslo.messaging._drivers.impl_rabbit [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [d99c75f5-424d-4d6a-8d60-fb76ba9312cc] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:28:59.837983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:28:59.842661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:28:59.854701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:59.855628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:59.856402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:59.857648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:28:59.858489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:28:59.859217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:28:59.926903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e6992f7-2aeb-479a-9bd2-9df32e8b0071 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096411 Aug 31 12:28:59.928192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 787/1555] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:28:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:00.658974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:00.662380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:00.670670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:00.671383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:00.671941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:00.672785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:00.673335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:00.673845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:00.716871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-90144117-8644-496d-88cc-172951ef2c99 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066332 Aug 31 12:29:00.717458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 788/1556] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:00.788051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [d99c75f5-424d-4d6a-8d60-fb76ba9312cc] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35638. Aug 31 12:29:00.872930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-858eee9d-9209-476e-9fe3-c51dd407fb3b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/action" status: 200 len: 37886 microversion: 2.20 time: 1.165306 Aug 31 12:29:00.874135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 769/1557] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 31 12:28:59 2022] POST /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be/action => generated 37886 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:29:00.947725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:00.951185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:00.961211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:00.962312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:00.963129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:00.964790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:00.965711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:00.966926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:01.025535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4ab6b63-7e00-4454-adbd-eedd3a800a8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085212 Aug 31 12:29:01.026870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 789/1558] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:01.737205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:29:01.741205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:01.745545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=86 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:01.756911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:01.757695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:01.758356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:01.759626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:01.760422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:01.761186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:01.889304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b77910e-f828-4f3d-be65-c54251d49a32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action" status: 200 len: 82316 microversion: 2.1 time: 0.159953 Aug 31 12:29:01.896016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 770/1559] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:29:01 2022] POST /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/action => generated 82316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:29:01.905702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:01.906772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:01.913455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:01.913935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:01.914369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:01.915101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:01.915578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:01.915993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:02.044081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:02.046765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:02.056659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:02.057451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:02.058183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:02.059398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:02.060156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:02.060848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:02.107321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-517e83c8-7075-4bb5-a191-c8130df0cccb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068437 Aug 31 12:29:02.107920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 771/1560] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:02.120015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lazy-loading 'services' on Instance uuid ada8fc37-de0f-4cbd-9c71-0ed57100787a {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:29:02.312901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Request method failure captured: Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments/487ee81b-f8c3-407a-94ff-cfb9399ce87d HTTP/1.1 Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1HoFL0Lb3kAuFXrN0cRv2OpOyJ6RsyOeKMPU7gFq5jtjn9X1uME0oWZgYva7WeMbvrh0pQK71gKM_dK0Wbi1UBadrB8Rium5FLiNKFEtJkJCpz84-VNOnieTraxlA2Fhcib45x0DEfHg8xMYyQIqRsl0PIT6qRYcXySqJo2Qd9pWEw Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 2188dd8748d540ee8df3689bd8538bc8 Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestMinimumBasicScenario-1771240232 Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:29:02.317175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2188dd8748d540ee8df3689bd8538bc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2188dd8748d540ee8df3689bd8538bc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2188dd8748d540ee8df3689bd8538bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2188dd8748d540ee8df3689bd8538bc8", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestMinimumBasicScenario-1771240232 Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 2188dd8748d540ee8df3689bd8538bc8 Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1771240232 Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-TestMinimumBasicScenario-1771240232-project Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 0987854672d0472ea9dfdfa2d1900a3b Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestMinimumBasicScenario-1771240232-project Aug 31 12:29:02.320277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'server_id': 'ada8fc37-de0f-4cbd-9c71-0ed57100787a', 'id': '487ee81b-f8c3-407a-94ff-cfb9399ce87d'} Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 12:29:02.321679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:29:02.324172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:02.326534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:02.328950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) Aug 31 12:29:02.331118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:29:02.333629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e356dcc-1ac2-4464-8702-7ebedee0a7c6) {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:29:02.333629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3ea1f9d7-5cf3-4c56-9b9e-f1b147a12629 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments/487ee81b-f8c3-407a-94ff-cfb9399ce87d" status: 400 len: 269 microversion: 2.1 time: 0.418618 Aug 31 12:29:02.333629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 790/1561] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:29:01 2022] DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a/os-volume_attachments/487ee81b-f8c3-407a-94ff-cfb9399ce87d => generated 269 bytes in 420 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:29:03.121658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:03.123947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:03.131870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:03.132414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:03.132850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:03.133571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:03.134057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:03.134566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:03.180826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3969ffd8-440b-4458-b36c-0a2adc2df6bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063492 Aug 31 12:29:03.181900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 772/1562] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:03.355054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:03.356011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:03.363643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:03.364126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:03.364558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:03.365269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:03.365719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:03.366140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:03.460415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lazy-loading 'services' on Instance uuid 8f08033a-e077-4eec-8c66-7ee2b37678a8 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:29:03.624808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-acf4a877-3bb2-4714-8612-2f23064fb6ba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8/os-volume_attachments/6bfa22da-28dc-4a7c-bb98-63d14c4ed246" status: 202 len: 0 microversion: 2.1 time: 0.274748 Aug 31 12:29:03.625579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 791/1563] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:29:03 2022] DELETE /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8/os-volume_attachments/6bfa22da-28dc-4a7c-bb98-63d14c4ed246 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:29:04.197578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:04.199911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:04.207371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:04.207867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:04.208305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:04.209024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:04.209478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:04.209902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:04.256997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0c301aa-d705-41eb-a447-48f22343f368 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063324 Aug 31 12:29:04.258067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 773/1564] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:05.274243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:05.276936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:05.284469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:05.285037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:05.285488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:05.286574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:05.287126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:05.287594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:05.328054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea250d03-eea3-4b14-9ae7-ed1e52a949b6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057920 Aug 31 12:29:05.328635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 792/1565] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:06.344629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:06.348369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:06.360502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:06.361284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:06.362059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:06.363364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:06.364124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:06.364827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:06.404502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c9261ad-7e1c-4fc2-8368-8e6d4347ab61 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067584 Aug 31 12:29:06.405772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 774/1566] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:07.418755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:07.421988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:07.429408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:07.429902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:07.430390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:07.431151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:07.432364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:07.432364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:07.473878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1f7d54d-6d63-43ea-84ee-0acc40cee49e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059769 Aug 31 12:29:07.474468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 793/1567] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:08.492120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:08.495005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:08.503844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:08.504362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:08.504799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:08.505559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:08.505994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:08.506418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:08.543251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b1d7fe14-233a-454b-9560-04f29f35d65a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056738 Aug 31 12:29:08.543888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 775/1568] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:09.558623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:09.561648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:09.570932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:09.571676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:09.572398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:09.573301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:09.573909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:09.574441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:09.612628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a563c404-64bd-4a0a-a8e9-249dba4ed5e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059666 Aug 31 12:29:09.613637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 794/1569] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:10.626003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:10.628304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:10.638246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:10.638754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:10.639181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:10.640262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:10.640449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:10.640872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:10.671741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:10.683280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14cd7f9f-748f-4e90-8bb6-3151aaa15a13 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061311 Aug 31 12:29:10.684031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 776/1570] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:11.697040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:11.699462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:11.707159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:11.707741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:11.708287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:11.709189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:11.709794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:11.710330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:11.758009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:11.767605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0135a37f-02a9-466e-ba46-6b81ea0ddb60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074545 Aug 31 12:29:11.768431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 795/1571] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:12.785695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:12.789470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:12.802086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:12.802952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:12.803741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:12.804962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:12.805782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:12.806488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:12.867978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a9c081b-542b-4ec2-877e-cbc4f3137134 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089252 Aug 31 12:29:12.869190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 777/1572] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:13.885167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:13.887585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:13.891340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=62 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:13.899734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:13.899734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:13.900217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:13.900987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:13.901631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:13.902196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:13.939938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c0bea31-a9f7-4752-b9c0-15dcc6da686d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059419 Aug 31 12:29:13.940585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 796/1573] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:14.959011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:14.962823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:14.975025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:14.975908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:14.976681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:14.977958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:14.978778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:14.979590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:15.029243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6341ad87-2334-4ed5-8c39-adb361c0618c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079632 Aug 31 12:29:15.030052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 778/1574] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:16.049782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:16.053661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:16.065707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:16.066625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:16.067454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:16.068778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:16.069626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:16.070385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:16.136122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c6aeadd-1f4d-4280-ae06-f0bc41ff51b0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094060 Aug 31 12:29:16.137128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 797/1575] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:17.153067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:17.155609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:17.165340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:17.166153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:17.166830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:17.168065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:17.168809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:17.169596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:17.205513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-022dec26-ff91-45d5-98b5-1c36d2109130 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056601 Aug 31 12:29:17.206331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 779/1576] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:18.222347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:18.226135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:18.238177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:18.238915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:18.239625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:18.240845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:18.241651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:18.242392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:18.303874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6e508f18-69cf-4b51-817c-f2a809e2d30d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088263 Aug 31 12:29:18.304918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 798/1577] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:19.321708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:19.324488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:19.332867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:19.333515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:19.334082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:19.335034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:19.335579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:19.335973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:19.371035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2b51310-393a-403b-bf66-60c0caa11c9f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054044 Aug 31 12:29:19.371665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 780/1578] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:20.384436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:20.387667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:20.397625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:20.398113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:20.398539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:20.399286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:20.399754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:20.400173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:20.437783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a22491ae-40c9-41f3-94e8-d06c6ef6d33f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057482 Aug 31 12:29:20.438578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 799/1579] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:21.454042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:21.456321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:21.465107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:21.465764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:21.466200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:21.467434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:21.468214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:21.468754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:21.528733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c6c6463-fdde-41ce-acb6-8fc378270ce1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080162 Aug 31 12:29:21.529835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 781/1580] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:22.544758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:22.547093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:22.555878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:22.556749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:22.557518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:22.558777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:22.559606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:22.560730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:22.617649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-079d178e-2dc3-42fb-95b7-387271f28152 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078632 Aug 31 12:29:22.618463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 800/1581] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:23.631576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:23.634284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:23.643069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:23.644033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:23.644428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:23.645193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:23.645750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:23.646378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:23.693183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-69d7f3f9-d345-46cc-9ca6-c5627d0155f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066510 Aug 31 12:29:23.693792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 782/1582] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:24.710132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:24.712413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:24.723131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:24.723737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:24.724183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:24.724919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:24.725376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:24.725801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:24.766461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d9d4b42-78d7-4c2f-9a8e-c5db425397f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060527 Aug 31 12:29:24.767076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 801/1583] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:25.781875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:25.784144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:25.791805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:25.792297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:25.792763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:25.793504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:25.793957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:25.794377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:25.829890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e0b7b5c0-659d-49f8-979f-6fb66021427e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052520 Aug 31 12:29:25.830480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 783/1584] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:26.844192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:26.846617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:26.854666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:26.855164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:26.855636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:26.856357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:26.856809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:26.857376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:26.900702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b66bd65a-264e-4047-8f96-4d2c02519daa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060747 Aug 31 12:29:26.901728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 802/1585] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:27.918110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:27.922013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:27.936342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:27.937209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:27.937965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:27.939200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:27.939966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:27.940613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:28.014664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d293f54-f109-47af-9c1f-b07775e5ba12 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100415 Aug 31 12:29:28.015731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 784/1586] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:29.031143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:29.033977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:29.041543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:29.042027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:29.042460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:29.043286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:29.043754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:29.044182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:29.092003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-53771cc0-c2db-4fd5-9527-5c8271226459 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064975 Aug 31 12:29:29.093060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 803/1587] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:30.109917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:30.113966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:30.125681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:30.126555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:30.127217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:30.128527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:30.129374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:30.130145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:30.191721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-44703dbc-4d8e-4c2b-a86f-6e156c2c8785 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089269 Aug 31 12:29:30.192321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 785/1588] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:31.205687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:31.207992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:31.215122 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:31.215644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:31.216073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:31.216830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:31.217303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:31.217787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:31.254755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3fc55c40-4192-46d3-9892-546d281116aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053529 Aug 31 12:29:31.255382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 804/1589] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:32.269132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:32.271723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:32.274705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=32 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:32.285416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:32.286274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:32.287015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:32.288365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:32.289199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:32.289942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:32.347913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40604eb6-6b2d-42e9-b5f6-8d1d5464cc99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082962 Aug 31 12:29:32.348959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 786/1590] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:33.368284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:33.371994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:33.384959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:33.385725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:33.386446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:33.387691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:33.388676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:33.389388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:33.459990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-327d5f12-4661-4298-96d4-b105dd2cc5cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098653 Aug 31 12:29:33.460650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 805/1591] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:34.478362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:34.482387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:34.494013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:34.494888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:34.495697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:34.497042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:34.498011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:34.498810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:34.559947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-139db93c-eab9-4764-991b-2f3d12f06c0a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090093 Aug 31 12:29:34.560876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 787/1592] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:35.576758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:35.579435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:35.587298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:35.587870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:35.588350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:35.589129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:35.589721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:35.590199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:35.633823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44b8b2ec-65ec-4acb-82e9-b96bfdebf7cb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062103 Aug 31 12:29:35.634856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 806/1593] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:36.650272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:36.652590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:36.661339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:36.661840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:36.662254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:36.663959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:36.663959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:36.664501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:36.711450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-12dd8948-8f0d-4a03-866a-eee6c93d9d31 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066754 Aug 31 12:29:36.712109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 788/1594] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:37.728146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:37.730761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:37.738676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:37.739083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:37.739579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:37.740298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:37.740747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:37.741425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:37.779101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6bebe41c-e669-4d74-8322-018dd0d9aee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055119 Aug 31 12:29:37.780072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 807/1595] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:38.796455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:38.800220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:38.812452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:38.813262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:38.813971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:38.815190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:38.816010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:38.816740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:38.864539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-05a7cefe-c623-41bf-8216-a15a573a1b68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075248 Aug 31 12:29:38.865355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 789/1596] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:39.881038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:39.883996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:39.892804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:39.893429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:39.893865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:39.894707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:39.895952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:39.896401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:39.940940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-06722af6-de6c-4a62-b778-c4e69d921d04 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065559 Aug 31 12:29:39.941773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 808/1597] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:40.956194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:40.959218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:40.967884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:40.968434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:40.968912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:40.969716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:40.970384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:40.970855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:40.974529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=80 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:41.012146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eacedf63-dadd-48fc-bdd9-91a9df060c52 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061359 Aug 31 12:29:41.013243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 790/1598] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:42.030960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:42.033404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:42.043891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:42.044747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:42.045459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:42.046602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:42.047382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:42.048106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:42.100005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a59c1992-3856-4e1c-bd11-5ddf145d68a5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074372 Aug 31 12:29:42.100675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 809/1599] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:43.114516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:43.116778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:43.124821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:43.125309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:43.125740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:43.126447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:43.126893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:43.127355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:43.164942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2ca5e3a-220e-451c-8ff0-7b816fe871dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054257 Aug 31 12:29:43.164942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 791/1600] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:44.177707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:44.180428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:44.183367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=28 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:44.190503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:44.191051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:44.191597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:44.192473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:44.192979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:44.193516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:44.201564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=86 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:44.250273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4e7fa5aa-7b06-4780-aeb4-fa71187a51f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076939 Aug 31 12:29:44.251275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 810/1601] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:45.268549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:45.271370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:45.288414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:45.289238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:45.289976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:45.291163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:45.292000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:45.292680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:45.345716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ddf96fbb-f6ba-4751-8c15-44169d3abcf9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082978 Aug 31 12:29:45.346754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 792/1602] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:46.361921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:46.364582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:46.373305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:46.373888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:46.374374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:46.375275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:46.375872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:46.376343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:46.418288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0f43f30d-9fc0-458c-92cc-70153d2195e4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061665 Aug 31 12:29:46.418927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 811/1603] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:47.437995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:47.441615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:47.452761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:47.453586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:47.454327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:47.455567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:47.456430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:47.456996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:47.495982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c1d124a8-9f5f-4cda-9ac0-557681fef267 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065428 Aug 31 12:29:47.497042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 793/1604] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:48.512136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:48.516598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:48.526651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:48.527506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:48.528205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:48.530272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:48.530820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:48.531330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:48.581136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0672cb86-e6f7-473a-a98f-e075da7ecb96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074014 Aug 31 12:29:48.582264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 812/1605] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:49.598133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:49.601050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:49.610852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:49.611496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:49.611950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:49.612704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:49.613185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:49.613613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:49.650595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa0128d9-5e12-4330-b04a-a0470c028bec tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057571 Aug 31 12:29:49.651394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 794/1606] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:50.665086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:50.667402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:50.675257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:50.675861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:50.676333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:50.677093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:50.677580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:50.678040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:50.716768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f38bbfd8-7445-4a9d-8e9c-bf855154a378 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055919 Aug 31 12:29:50.717778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 813/1607] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:29:51.740277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:51.744226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:51.756872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:51.757682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:51.758424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:51.759891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:51.760856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:51.761562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:51.827019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8fc54c5-5190-45b1-85e6-44d55c735121 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096984 Aug 31 12:29:51.828107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 795/1608] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:52.846872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:52.850233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:52.861004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:52.861727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:52.862379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:52.863557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:52.864240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:52.864864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:52.918249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b2d30e4-2da8-4441-bcc1-13b1f44904be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078249 Aug 31 12:29:52.919190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 814/1609] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:53.936243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:53.939679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:53.950241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:53.950983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:53.951932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:53.952798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:53.953487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:53.954113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:53.995971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d80785c-c87d-4849-9745-e589a717cfab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066211 Aug 31 12:29:53.997356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 796/1610] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:55.017592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:55.021445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:55.032080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:55.032681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:55.033157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:55.034053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:55.034481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:55.034940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:55.074111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea0a415f-1c33-4550-86f7-848ecc277cd6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063232 Aug 31 12:29:55.074708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 815/1611] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:56.091995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:56.095457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:56.108347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:56.108347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:56.108347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:56.108347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:56.108922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:56.109043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:56.158048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-031d4472-0c58-44e3-86c5-0922cc14df96 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071878 Aug 31 12:29:56.158563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 797/1612] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:57.174891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:57.177353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:57.185142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:57.185693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:57.186217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:57.187066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:57.187619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:57.188163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:57.232979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-79f51650-beea-4c42-b777-028d7a8ac116 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065319 Aug 31 12:29:57.233765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 816/1613] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:58.247012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:58.249405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:58.256549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:58.257038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:58.257534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:58.258260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:58.258713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:58.259137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:58.296886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9dcae222-7bad-40c3-8756-48b220620dde tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054409 Aug 31 12:29:58.297490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 798/1614] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:29:59.313624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:29:59.316089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:29:59.325079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.325795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.326326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.327091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:29:59.327636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:29:59.328020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:29:59.366672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba309710-9452-40d1-a1a6-3b419188e694 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057717 Aug 31 12:29:59.367267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 817/1615] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:29:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:00.380192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:00.382454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:00.391288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:00.391954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:00.392503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:00.393370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:00.393931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:00.394472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:00.463759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f75bd434-1504-4008-8632-e75f91ade04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087370 Aug 31 12:30:00.464816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 799/1616] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:01.483963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:01.487949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:01.500581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:01.501429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:01.502214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:01.503552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:01.504357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:01.505107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:01.567988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cd22ab53-9113-4fd9-95a9-1d51c5f9fe5e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091441 Aug 31 12:30:01.569026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 818/1617] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:02.584937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:02.587312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:02.591738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=28 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:02.599162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:02.599773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:02.600343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:02.601200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:02.601697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:02.602165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:02.642410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3de474c0-6548-456d-bed6-67ad707f78c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061737 Aug 31 12:30:02.643048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 800/1618] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:03.661162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:03.664924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:03.676286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:03.676780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:03.677219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:03.677949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:03.678408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:03.678833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:03.729599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2bf31a19-b8f2-4d76-862a-cf6db04c0aa6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075430 Aug 31 12:30:03.731443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 819/1619] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:04.746076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:04.748862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:04.759222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:04.760165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:04.761144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:04.763553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:04.764417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:04.765214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:04.803205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5f343ff1-eea2-4cdf-bb70-6d53908f9793 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061379 Aug 31 12:30:04.803943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 801/1620] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:05.816751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:05.819321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:05.828007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.828652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.829191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.829956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:05.830400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:05.830829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:05.870313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-59da1a3d-06ca-4801-990e-a254dbab026c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058120 Aug 31 12:30:05.871257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 820/1621] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:06.892688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:06.895165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:06.907596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:06.908433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:06.909402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:06.910621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:06.911150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:06.911669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:06.963084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c06898f7-1b20-40b0-9d63-f56b05df57ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077269 Aug 31 12:30:06.964142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 802/1622] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:07.982950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:07.985322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:07.993187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:07.993918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:07.994656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:07.996510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:07.997338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:07.998040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:08.038322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-08fcc095-82d5-4a32-a9e8-25fdbc5641e8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062042 Aug 31 12:30:08.038964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 821/1623] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:09.054535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:09.057238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:09.067128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:09.067927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:09.068645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:09.069898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:09.070548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:09.071220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:09.116330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-770e8414-a11e-4440-a698-9cb553bea3cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066593 Aug 31 12:30:09.117651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 803/1624] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:10.133429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:10.138480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:10.149101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:10.150012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:10.150991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:10.152410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:10.153206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:10.162753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:10.194450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bead7601-6d09-47e6-b2d8-ab6f9f45766d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065315 Aug 31 12:30:10.195145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 822/1625] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:11.213315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:11.217511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:11.229400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.230565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.231709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.233294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:11.234143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:11.234964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:11.239853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=84 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:11.299853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37d23561-97d1-42af-bc72-770c6e7a42dc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095132 Aug 31 12:30:11.300954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 804/1626] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:12.319506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:12.323346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:12.336594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.337497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.338251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.339703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:12.340366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:12.341264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:12.402322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3b632114-47b5-446a-8e91-75baa031b163 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089219 Aug 31 12:30:12.404048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 823/1627] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:13.421120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:13.423723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:13.431681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:13.432266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:13.432846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:13.434149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:13.435294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:13.435736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:13.483688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-349b77f1-f45f-45e6-9765-f3ec7b797dee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068196 Aug 31 12:30:13.484282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 805/1628] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:14.501655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:14.505960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:14.511965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=28 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:14.519602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:14.520463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:14.521198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:14.522634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:14.523504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:14.524270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:14.532549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=84 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:14.583991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9fc1411f-bbc8-45d9-9a29-a45201d008c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089692 Aug 31 12:30:14.584978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 824/1629] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:15.597660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:15.599978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:15.610844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:15.611380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:15.611825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.612609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:15.613059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:15.613476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:15.660552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8974f55-32e7-4d7e-83fc-fd682c0c0c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066875 Aug 31 12:30:15.661302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 806/1630] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:16.677460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:16.680623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:16.688561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:16.689058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:16.689578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:16.690322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:16.690842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:16.691308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:16.736983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b36cd466-1fb0-4963-bff2-c2a4fe5ecd69 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063921 Aug 31 12:30:16.737575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 825/1631] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:17.752733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:17.755447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:17.763639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:17.764215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:17.764610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:17.765347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:17.766025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:17.766725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:17.812371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a44972fb-a708-4923-be51-c41a90517b9b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063847 Aug 31 12:30:17.812990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 807/1632] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:18.831128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:18.833920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:18.845616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:18.846439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:18.847175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:18.848471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:18.849230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:18.849848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:18.901940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b7419b5-8041-44b5-a115-105d80177696 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078153 Aug 31 12:30:18.902660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 826/1633] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:19.920321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:19.924167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:19.937387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:19.938272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:19.939086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:19.940583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:19.941416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:19.942179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:19.995078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1de2b69-78ca-4fb6-83a4-004aa09d3f01 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082721 Aug 31 12:30:19.996636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 808/1634] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:21.015626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:21.020394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:21.032402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.033417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.033960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.035541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:21.036380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:21.037145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:21.083160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-28c7f5df-43a3-4e4a-95df-824131bd0651 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076409 Aug 31 12:30:21.084115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 827/1635] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:22.104628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:22.108474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:22.120847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:22.121824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:22.122565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:22.123873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:22.124651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:22.125459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:22.166885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0384299c-5997-453a-b891-77e15ebc4510 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069649 Aug 31 12:30:22.168536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 809/1636] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:23.181909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:23.184224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:23.191278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.191772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.192206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.192929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:23.193385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:23.193808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:23.233212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18cf95ae-6774-47a3-87ae-71d1a860da99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055091 Aug 31 12:30:23.234365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 828/1637] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:24.248150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:24.250675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:24.258658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.259186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.259703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.260797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:24.261272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:24.261700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:24.321136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-642c97e4-a23c-487f-8d29-840c0984e5da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077032 Aug 31 12:30:24.322175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 810/1638] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:25.338246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:25.341390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:25.352592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.353394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.354114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.355354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:25.356104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:25.356800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:25.409523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3844826f-cfe7-4bc4-be11-9d598da4d7f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075389 Aug 31 12:30:25.410444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 829/1639] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:26.427107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:26.432439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:26.439440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.439985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.440558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.441278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:26.443325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:26.443325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:26.493916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f78579ab-d8fa-4579-aba9-96a3f316a492 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071241 Aug 31 12:30:26.494510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 811/1640] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:27.512830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:27.516775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:27.529332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:27.530113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:27.530833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:27.532042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:27.532813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:27.533486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:27.596200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a99321b-dca8-463c-8dcc-02fe440c1229 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091016 Aug 31 12:30:27.597668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 830/1641] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:28.614687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:28.618519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:28.629953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:28.630827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:28.631674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:28.632948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:28.633756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:28.634480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:28.684807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2f1d70c8-a29d-48dd-a4ba-2c01b318afc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077485 Aug 31 12:30:28.685792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 812/1642] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:29.702817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:29.705787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:29.716068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.716923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.717615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.718516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:29.719145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:29.719766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:29.759065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b7b89d90-b1fb-4ddf-8180-3a6d386eb2df tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060574 Aug 31 12:30:29.760118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 831/1643] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:30.774884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:30.778399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:30.786966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:30.787955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:30.788480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.789291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:30.789846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:30.790378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:30.850914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-69e04b25-8702-4ac7-8ccd-a09ec053237c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079994 Aug 31 12:30:30.852201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 813/1644] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:31.871884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:31.875821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:31.887469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.888362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.889220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.890545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:31.891146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:31.891970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:31.951595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-21b7d78e-c1c7-4521-8311-e9258ebd49ba tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086967 Aug 31 12:30:31.952556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 832/1645] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:32.971041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:32.977046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:32.985674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=28 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:32.989190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:32.990483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:32.991349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:32.992684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:32.993502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:32.994276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:33.058571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-119ff3d1-fe93-4485-97c1-e69a5f93fc94 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095354 Aug 31 12:30:33.060120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 814/1646] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:34.075761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:34.078099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:34.086287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:34.086952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:34.087606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:34.088610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:34.089257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:34.095185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:34.138535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f337f4ee-221a-4d10-ba62-d1b649a6e48c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067182 Aug 31 12:30:34.139676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 833/1647] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:35.158716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:35.162574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:35.174442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.175138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.175805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.176931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:35.177660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:35.178496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:35.237043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d898850e-b167-4d72-81c6-500cf17da287 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086042 Aug 31 12:30:35.238087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 815/1648] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:36.262789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:36.266188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:36.281780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.282697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.283900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.287954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.288987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.290059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.344836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b526a1da-28de-42f2-a5c6-f79b1f536494 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097418 Aug 31 12:30:36.345444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 834/1649] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:36.827814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:36.828663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:36.840990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.841782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.842547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.843846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:36.844629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:36.845346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:36.892233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:30:37.052013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de040a38-994e-4059-8add-35542b47552d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 204 len: 0 microversion: 2.1 time: 0.231416 Aug 31 12:30:37.053006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 816/1650] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:30:36 2022] DELETE /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:30:37.062901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:37.063572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:37.071430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.071919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.072354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.073076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.073552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.074081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.257348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:37.272892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2b1ce83-d93d-479d-8810-e09b77401faf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1681 microversion: 2.1 time: 0.211558 Aug 31 12:30:37.274082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 835/1651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:37 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:37.363724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:37.369097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:37.379344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.380704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.380704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.381117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:37.381794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:37.381993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:37.428030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40b6e971-40a4-4399-a601-b7575a46f649 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071305 Aug 31 12:30:37.429314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 817/1652] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:38.310770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:38.312029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:38.328102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.329003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.329816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.331112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.332090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.332917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.463217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:38.468182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:38.481363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.482091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.482780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.484125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:38.484978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:38.485702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:38.515558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:38.524752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e6149815-5c79-415a-af60-2d502068e5a0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1614 microversion: 2.1 time: 0.221681 Aug 31 12:30:38.525351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 836/1653] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:38 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1614 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:38.564034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4e1d7f7c-527c-4268-a3f5-46238a89d80b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121210 Aug 31 12:30:38.566450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 818/1654] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:38.979969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:30:38.979969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:30:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 31 12:30:39.092719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a6fd4ffa-4762-48f5-a80f-3afb05610897 req-0b5564ac-c2fd-4230-8dd1-7170b8d6edcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659e57d5-c27a-45e8-96b5-0a115cec46ee", "name": "network-vif-deleted", "tag": "a7e90a3c-3dc3-407f-85aa-1369258bd64b"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:39.113608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a6fd4ffa-4762-48f5-a80f-3afb05610897 req-0b5564ac-c2fd-4230-8dd1-7170b8d6edcd service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.114847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a6fd4ffa-4762-48f5-a80f-3afb05610897 req-0b5564ac-c2fd-4230-8dd1-7170b8d6edcd service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.115961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a6fd4ffa-4762-48f5-a80f-3afb05610897 req-0b5564ac-c2fd-4230-8dd1-7170b8d6edcd service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.151365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a6fd4ffa-4762-48f5-a80f-3afb05610897 req-0b5564ac-c2fd-4230-8dd1-7170b8d6edcd service nova] Creating event network-vif-deleted:a7e90a3c-3dc3-407f-85aa-1369258bd64b for instance 659e57d5-c27a-45e8-96b5-0a115cec46ee on hv-cinder-85535 Aug 31 12:30:39.165375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a6fd4ffa-4762-48f5-a80f-3afb05610897 req-0b5564ac-c2fd-4230-8dd1-7170b8d6edcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192463 Aug 31 12:30:39.173062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 837/1655] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:39.551142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:39.552073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:39.563959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.564805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.565654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.567009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.567895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.568681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.577839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:39.584232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:39.598848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:39.625114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.626054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.635927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.638565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.643501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.644956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.661877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:39.663438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:39.664618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:39.665850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lazy-loading 'fault' on Instance uuid 659e57d5-c27a-45e8-96b5-0a115cec46ee {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:30:39.720778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a08cc1ae-c72d-4997-b04b-672de9416433 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145302 Aug 31 12:30:39.721702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 838/1656] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:39.853297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:39.878907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-776fcb15-2be3-4626-8ae1-5fe5af0727bc tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 200 len: 1331 microversion: 2.1 time: 0.331003 Aug 31 12:30:39.882508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 819/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:39 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 1331 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:40.739793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:40.742194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:40.749730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.750221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.750777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.751560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.752038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.752586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.811526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e6eef28-dc34-47e5-86a6-89bf2c0aacf0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076967 Aug 31 12:30:40.812668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 839/1658] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:40.909382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:40.910534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:40.922216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.923024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.923600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.924497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:40.925343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:40.926043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:40.954082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee HTTP/1.1 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:30:40.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:30:40.960002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '659e57d5-c27a-45e8-96b5-0a115cec46ee'} Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:30:40.961556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:30:40.964162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:30:40.966402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:30:40.966402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2149e70b-17cb-4c53-9f56-75ef9abf6210 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 404 len: 111 microversion: 2.1 time: 0.058791 Aug 31 12:30:40.966402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 820/1659] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:40 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:30:40.972342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34921db0-bbd1-4039-9739-a2cbc4dcbc2c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '.version_select at 0x7fe854bf1e50>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:41.002370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34921db0-bbd1-4039-9739-a2cbc4dcbc2c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334419835" status: 202 len: 0 microversion: 2.1 time: 0.034331 Aug 31 12:30:41.003109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 840/1660] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 31 12:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334419835 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:30:41.830622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:41.834862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:41.848604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.849527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.850501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.851877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:41.852852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:41.853810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:41.897647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c8a3613-e1ae-4ad4-99a8-f3eaa21a5c22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075551 Aug 31 12:30:41.899427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 821/1661] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:30:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:41.998417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9dd8e638-509b-4452-a419-028f0550b2d8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: .version_select at 0x7fe854e468b0>, body: {"keypair": {"name": "tempest-keypair-1426517055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOXjCnKzelnAqBtUALxjGCelSkVYpYsVriITA+V5rfSiv2fVoIhFqNxj0xSPxZwO2deNwJ4vUgDMTD4ovZ7qp9TB3NOv4wSyvSpr/Y3djrPFRhM+zKfFbyITnJwnBSIMA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:42.031047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-9dd8e638-509b-4452-a419-028f0550b2d8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:30:42.039135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-9dd8e638-509b-4452-a419-028f0550b2d8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:30:42.082370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9dd8e638-509b-4452-a419-028f0550b2d8 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091382 Aug 31 12:30:42.083316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 841/1662] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:30:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:42.926493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:42.930387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:42.943104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:42.943874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:42.944770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:42.945708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:42.946630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:42.947788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:43.062684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-879afa9d-5600-48e3-92e0-2e8316000e8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action" status: 200 len: 76056 microversion: 2.1 time: 0.143511 Aug 31 12:30:43.064075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 822/1663] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:30:42 2022] POST /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda/action => generated 76056 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:30:44.226634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1347164013", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72511f19-18eb-4ec4-87f2-a581216ea81a"}], "security_groups": [{"name": "tempest-securitygroup--260007852"}], "key_name": "tempest-keypair-1426517055", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:44.372514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] validate_networks() for [('72511f19-18eb-4ec4-87f2-a581216ea81a', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:30:44.648269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:45.017220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:30:45.017764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:30:45.018333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:30:45.018833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:30:45.019434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:30:45.030839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:45.031533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:45.032142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:45.033007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:45.033607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:45.034186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:45.041275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=92 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:45.057422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:30:45.063369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Getting quotas for user 4c3e5c1776b8470a9b677bac8dfbc9e6 and project 16f3955065954f8f860bada6261223c4. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:30:45.077406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:30:45.079765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:30:45.140235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a863aee2-7225-4272-8562-9f0e88d99748 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.922526 Aug 31 12:30:45.140980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 842/1664] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:30:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:30:45.162118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5369e6e2-3d71-4afb-ae8c-222737719585 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:45.163953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5369e6e2-3d71-4afb-ae8c-222737719585 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:45.272972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5369e6e2-3d71-4afb-ae8c-222737719585 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:45.288981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5369e6e2-3d71-4afb-ae8c-222737719585 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1242 microversion: 2.1 time: 0.134828 Aug 31 12:30:45.299274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 823/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:45 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:46.331387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:46.332540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:46.343987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.344792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.345505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.346678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:46.347502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:46.348252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:46.466638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:46.476156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3b79a9a7-5f3c-45af-b675-6d0ca1abe8c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1294 microversion: 2.1 time: 0.152946 Aug 31 12:30:46.477223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 843/1666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:46 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:47.505218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:47.512129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:47.544645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:47.545865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:47.546909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:47.548154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:47.548819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:47.550163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:47.788988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:47.804648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb8ad587-0701-42af-8c8a-3face2992af0 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1300 microversion: 2.1 time: 0.309452 Aug 31 12:30:47.808364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 824/1667] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:47 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1300 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:48.834388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:48.835174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:48.854412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:48.855061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:48.855561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:48.860084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:48.861969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:48.862917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.272880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:49.287473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-62a113cb-294f-43d8-a3de-70854f3ae8f9 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1367 microversion: 2.1 time: 0.457731 Aug 31 12:30:49.288710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 844/1668] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:48 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:49.806850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e7a88919-a248-4ef8-a997-73c0abe2d8de req-f3bad1bc-fe95-43f0-bdb0-417325eebcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5bbaea-c876-457f-bbdd-96c967d56add", "tag": "f81103d9-f1f6-4a58-b7b2-95f293f80dd2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:49.832268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e7a88919-a248-4ef8-a997-73c0abe2d8de req-f3bad1bc-fe95-43f0-bdb0-417325eebcf2 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:49.834212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e7a88919-a248-4ef8-a997-73c0abe2d8de req-f3bad1bc-fe95-43f0-bdb0-417325eebcf2 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:49.835387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e7a88919-a248-4ef8-a997-73c0abe2d8de req-f3bad1bc-fe95-43f0-bdb0-417325eebcf2 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:49.859721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e7a88919-a248-4ef8-a997-73c0abe2d8de req-f3bad1bc-fe95-43f0-bdb0-417325eebcf2 service nova] Creating event network-changed:f81103d9-f1f6-4a58-b7b2-95f293f80dd2 for instance 6c5bbaea-c876-457f-bbdd-96c967d56add on hv-cinder-85535 Aug 31 12:30:49.873863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e7a88919-a248-4ef8-a997-73c0abe2d8de req-f3bad1bc-fe95-43f0-bdb0-417325eebcf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074046 Aug 31 12:30:49.875907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 825/1669] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:30:50.325744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:50.329083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:50.342489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:50.343784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:50.344561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:50.345921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:50.347592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:50.348320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:50.622883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:50.638169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85200357-2475-429c-8a16-89f61ea9728c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1367 microversion: 2.1 time: 0.319317 Aug 31 12:30:50.639727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 845/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:50 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:30:51.672961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:51.674289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:51.687467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:51.688921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:51.689736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:51.692941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:51.694014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:51.694887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:52.082134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:52.117998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3a5cbb9d-db8b-4f1b-a1ba-27fc6db4ed72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1367 microversion: 2.1 time: 0.456542 Aug 31 12:30:52.119670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 826/1671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:51 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:53.166034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:53.167192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:53.178154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:53.178891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:53.180782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:53.183225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:53.184364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:53.185096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:53.406916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:53.419552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a663d55d-f959-45a3-be7b-037fe26bf6c6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1367 microversion: 2.1 time: 0.265189 Aug 31 12:30:53.420513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 846/1672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:53 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:54.453088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:54.458368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:54.481402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:54.484277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:54.485692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:54.488864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:54.492796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:54.495668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:54.691040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-1cc587f7-27eb-4043-a9f2-739e6c3b9ad1 req-93694668-c67d-4309-90e0-32dbc3e4a776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5bbaea-c876-457f-bbdd-96c967d56add", "name": "network-vif-plugged", "status": "completed", "tag": "f81103d9-f1f6-4a58-b7b2-95f293f80dd2"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:54.708401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1cc587f7-27eb-4043-a9f2-739e6c3b9ad1 req-93694668-c67d-4309-90e0-32dbc3e4a776 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:54.709173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1cc587f7-27eb-4043-a9f2-739e6c3b9ad1 req-93694668-c67d-4309-90e0-32dbc3e4a776 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:54.709769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1cc587f7-27eb-4043-a9f2-739e6c3b9ad1 req-93694668-c67d-4309-90e0-32dbc3e4a776 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:54.728772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-1cc587f7-27eb-4043-a9f2-739e6c3b9ad1 req-93694668-c67d-4309-90e0-32dbc3e4a776 service nova] Creating event network-vif-plugged:f81103d9-f1f6-4a58-b7b2-95f293f80dd2 for instance 6c5bbaea-c876-457f-bbdd-96c967d56add on hv-cinder-85535 Aug 31 12:30:54.737440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-1cc587f7-27eb-4043-a9f2-739e6c3b9ad1 req-93694668-c67d-4309-90e0-32dbc3e4a776 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227211 Aug 31 12:30:54.739991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 847/1673] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:54.810507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:54.823453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e941bb8c-8146-4f59-859d-c74184369bac tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1367 microversion: 2.1 time: 0.382047 Aug 31 12:30:54.824157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 827/1674] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:54 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:55.857822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:55.860299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=10 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:55.869145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:55.870373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:55.891561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:55.892417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:55.893369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:55.894451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:55.895010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:55.895641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:56.112000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:56.128888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18d52349-052c-4d5e-84eb-74dd7f75a406 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1367 microversion: 2.1 time: 0.273495 Aug 31 12:30:56.129612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 848/1675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:55 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:57.164489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:57.165717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:57.170799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:57.178107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:57.179002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:57.180030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:57.181141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:57.181929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:57.182648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:57.438272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:30:57.453084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61b230d5-80f6-4f0a-bfde-c17d6419ac8a tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1557 microversion: 2.1 time: 0.293487 Aug 31 12:30:57.453764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 828/1676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:30:57 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1557 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:30:57.484257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:30:57.485119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:30:57.493399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:57.494170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:57.494889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:57.496141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:57.496894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:57.497699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:57.617184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-05183a2d-de23-4df5-9152-794588ea5509 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137115 Aug 31 12:30:57.618390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 849/1677] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:30:57 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:30:59.433190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-fec251de-b823-4f9e-b94c-c5aa6386e139 req-c2304a2e-94d2-40dd-8a66-bdb4e2f08d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5bbaea-c876-457f-bbdd-96c967d56add", "tag": "f81103d9-f1f6-4a58-b7b2-95f293f80dd2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:30:59.452137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-fec251de-b823-4f9e-b94c-c5aa6386e139 req-c2304a2e-94d2-40dd-8a66-bdb4e2f08d2e service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:30:59.453504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-fec251de-b823-4f9e-b94c-c5aa6386e139 req-c2304a2e-94d2-40dd-8a66-bdb4e2f08d2e service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:30:59.454238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-fec251de-b823-4f9e-b94c-c5aa6386e139 req-c2304a2e-94d2-40dd-8a66-bdb4e2f08d2e service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:30:59.476300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-fec251de-b823-4f9e-b94c-c5aa6386e139 req-c2304a2e-94d2-40dd-8a66-bdb4e2f08d2e service nova] Creating event network-changed:f81103d9-f1f6-4a58-b7b2-95f293f80dd2 for instance 6c5bbaea-c876-457f-bbdd-96c967d56add on hv-cinder-85535 Aug 31 12:30:59.486182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-fec251de-b823-4f9e-b94c-c5aa6386e139 req-c2304a2e-94d2-40dd-8a66-bdb4e2f08d2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168889 Aug 31 12:30:59.487194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 829/1678] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:31:35.961827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:35.962822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=37 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:35.968606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:31:35.969234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:31:35.978025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:35.978776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:35.979385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:35.980282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:31:35.980809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:31:35.981376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:31:36.033190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3c4b70f0-5dfe-4575-823d-d76652b784c5 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add/ips" status: 200 len: 150 microversion: 2.1 time: 0.073268 Aug 31 12:31:36.034210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 850/1679] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:31:35 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:01.056019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bff74b5-8e68-48fa-b0a3-36790413caa8] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:35:01.056678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:01.057430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=47 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:01.058780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:35:01.058965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:35:01.060133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:35:01.060314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:35:01.061912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:35:01.062151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:35:01.070256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:01.070926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:01.085184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.085894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.086482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.087525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.088097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.088652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.120354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:35:01.218134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a5a53ccc-837f-4adf-90b6-16212784b266 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 204 len: 0 microversion: 2.20 time: 0.163358 Aug 31 12:35:01.218673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 830/1680] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 31 12:35:01 2022] DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 12:35:01.232610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:01.233571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:01.237375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8ca93a4-1c4a-4044-babd-8dc211991fbb] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 12:35:01.238332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:01.239446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:01.240941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:35:01.241326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:35:01.243912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:35:01.244158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:35:01.245588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:35:01.245839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:35:01.268768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.269363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.269873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.270694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:01.271222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:01.271810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:01.659733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.676455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.679216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:01.681513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1021620b-01af-4c74-9c55-2e66a170aca0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1799 microversion: 2.20 time: 0.456123 Aug 31 12:35:01.682485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 851/1681] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1799 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:02.722967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:02.724207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:02.745337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bff74b5-8e68-48fa-b0a3-36790413caa8] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39082. Aug 31 12:35:02.748760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.749635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.750200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.751509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.752302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.753051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.883880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:02.910071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:02.913425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:02.923740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc4acde1-a72e-44b0-b32e-9ec6aaef6dd7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1732 microversion: 2.20 time: 0.205150 Aug 31 12:35:02.944451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 831/1682] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:02.959426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:02.962327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:02.978731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.979741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.980659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:02.982102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:02.983889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:02.984668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.029780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8ca93a4-1c4a-4044-babd-8dc211991fbb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39092. Aug 31 12:35:03.046351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:35:03.096571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:03.098115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:03.113031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.113530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.115063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.116055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.117140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.117606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.169965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:35:03.198062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5cf3b5a9-9184-4045-a81d-e58c1f651555 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 204 len: 0 microversion: 2.1 time: 0.247809 Aug 31 12:35:03.199538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 852/1683] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:35:02 2022] DELETE /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:35:03.210494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:03.211211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:03.218108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.218707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.219216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.220267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.220805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.221308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.364668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b9a2a04c-9e3e-4b08-9d2d-bc1570c262f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 204 len: 0 microversion: 2.1 time: 0.275123 Aug 31 12:35:03.365782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 832/1684] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:35:03 2022] DELETE /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:35:03.379003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:03.380826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:03.389331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.390880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.391554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.392635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.393447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.394050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.441839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:03.452695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f2cfc2d7-8083-46aa-b1c5-1d58848a348e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.247027 Aug 31 12:35:03.471361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 853/1685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:03.480893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-5cbb03d4-6aae-4b01-a112-836ab6c39808 req-5da717aa-7f83-45bc-b693-38250ebceb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd7c10d-e093-4252-a8a2-f47366d712be", "name": "network-vif-deleted", "tag": "7535e539-7873-4bd2-bce4-f6226e435642"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:35:03.494795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5cbb03d4-6aae-4b01-a112-836ab6c39808 req-5da717aa-7f83-45bc-b693-38250ebceb89 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.496251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5cbb03d4-6aae-4b01-a112-836ab6c39808 req-5da717aa-7f83-45bc-b693-38250ebceb89 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.508504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-5cbb03d4-6aae-4b01-a112-836ab6c39808 req-5da717aa-7f83-45bc-b693-38250ebceb89 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.557729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-5cbb03d4-6aae-4b01-a112-836ab6c39808 req-5da717aa-7f83-45bc-b693-38250ebceb89 service nova] Creating event network-vif-deleted:7535e539-7873-4bd2-bce4-f6226e435642 for instance 6cd7c10d-e093-4252-a8a2-f47366d712be on hv-cinder-85535 Aug 31 12:35:03.577227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-5cbb03d4-6aae-4b01-a112-836ab6c39808 req-5da717aa-7f83-45bc-b693-38250ebceb89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100966 Aug 31 12:35:03.578479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 854/1686] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:35:03.656827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:03.668039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9ad18e8f-c33d-4e5c-9274-e18a2a2308d5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.295413 Aug 31 12:35:03.668792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 833/1687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:03 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:03.968215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:03.969579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:03.976403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.977036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.977611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:03.978259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:03.978716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:03.979174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:04.407024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:04.417172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:04.418913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:04.420354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b7b6f2b4-14b9-4739-8f6c-1eb47dd6b734 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.457551 Aug 31 12:35:04.425038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 855/1688] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:04.482683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:04.484241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:04.493662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:04.494313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:04.494927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:04.496034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:04.496663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:04.497283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:04.697984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:04.699005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:04.711767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:04.713053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:04.713854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:04.715146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:04.724404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:04.725924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:04.736208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:04.767360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15c458d6-8f82-484b-8b49-89bf98a9aa36 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291391 Aug 31 12:35:04.769170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 834/1689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:04.954969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:04.966125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85e6a20b-3312-4389-b083-d06db91fb8de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.276408 Aug 31 12:35:04.966874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 856/1690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:04 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:05.454656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:05.455351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:05.463862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:05.464495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:05.465225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:05.466151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:05.466790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:05.468063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:05.552325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.567348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.569907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.571508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09884a65-5764-44c0-9c57-ca6ba3a35ad2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.122667 Aug 31 12:35:05.572379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 835/1691] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:05.805655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:05.806854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:05.814741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:05.815414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:05.815965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:05.816738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:05.817263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:05.817724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:05.991535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:05.992300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:05.992467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:05.999134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:05.999749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:06.000250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:06.001055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:06.001569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:06.002060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:06.008393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-02ebace3-eeb7-4968-843e-a38423b59891 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.207592 Aug 31 12:35:06.009431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 857/1692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:06.175792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.191278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b5e3cef-937d-47be-8270-3f1c5324b577 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.203708 Aug 31 12:35:06.192219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 836/1693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:05 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:06.599742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:06.601084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:06.609878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:06.610611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:06.611267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:06.612463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:06.613263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:06.613896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:06.713412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.729809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.733092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:06.735292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4d3bca43-74d5-491d-9db5-60c48a32103b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.141074 Aug 31 12:35:06.736348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 858/1694] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:07.044612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:07.045438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:07.053108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.053678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.054402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.055191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.055742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.056214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.220269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:07.222170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:07.225279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.233903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.234801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.235566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.236747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.237514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.238249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.239863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-21b01026-db4f-4aff-a58d-675010116d98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.198960 Aug 31 12:35:07.240936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 837/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:07.427298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.442952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ed222fd0-67d1-4850-ac4a-b04dbad96dcd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.226606 Aug 31 12:35:07.443992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 859/1696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:07 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:07.764906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:07.765598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:07.773099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.773609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.774101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.774867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:07.775363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:07.775793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:07.874935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.893463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.896714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:07.899322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c84bf9d9-14de-4fde-8f62-533b154829b3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.138401 Aug 31 12:35:07.900281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 838/1697] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:08.274462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:08.275194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:08.282395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.283055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.283707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.284743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.285300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.285728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.450730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:08.461300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5407031e-3e52-46f7-a898-9fd627de9e7f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.192425 Aug 31 12:35:08.461889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 860/1698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:08.478159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:08.478811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:08.486205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.486752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.487249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.488034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.488528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.488991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.663754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:08.675555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f97eaa1c-d42c-472a-bce8-05351a6c9b62 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.201430 Aug 31 12:35:08.676157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 839/1699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:08 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:08.941418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:08.942252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:08.951008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.951701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.952303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:08.953249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:08.953877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:08.954415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:09.038703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:09.056117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:09.059056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:09.061396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4a58d535-ba60-405f-8dad-d86c4b7dfbeb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124411 Aug 31 12:35:09.062375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 861/1700] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:09.489055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:09.490140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:09.501716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:09.502566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:09.503341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:09.504582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:09.505387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:09.506194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:09.700460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:09.701449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:09.711714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:09.715163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:09.716064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:09.716865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:09.718212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:09.719136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:09.719902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:09.725053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-88f40718-3a67-45af-82a2-0373fd658c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.243412 Aug 31 12:35:09.725890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 840/1701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:09.912278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:09.924081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18654aab-6dd1-4c2d-a14d-a00cfc94689b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.228930 Aug 31 12:35:09.924779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 862/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:09 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:10.100733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:10.101318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:10.110183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:10.110679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:10.111131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.111895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:10.112345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:10.112792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.188740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.205815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.208772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.210951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2dd6d2d2-96b2-4a54-bdfb-2dc1bafbd986 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.114049 Aug 31 12:35:10.212015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 841/1703] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:10.761819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:10.762568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:10.770266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:10.770782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:10.771223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.771994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:10.772439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:10.773333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.953984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:10.954572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:10.961994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:10.962488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:10.962902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.963675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:10.964161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:10.964586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:10.972226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:10.985751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e837c865-47c4-4693-a7da-9ee52f084d91 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.227989 Aug 31 12:35:10.986644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 863/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:11.147286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.157831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3ff95f8-7f70-4638-92b7-d009c4eeab63 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.209351 Aug 31 12:35:11.158424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 842/1705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:10 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:11.237677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:11.238478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:11.246620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:11.247129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:11.247731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:11.248916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:11.249205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:11.250080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:11.328858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.339282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.341102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:11.342708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-895f0719-f4a2-49f1-9807-7012f5b9a900 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.109157 Aug 31 12:35:11.343292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 864/1706] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:12.009081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:12.009864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:12.018133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.018623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.019029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.019808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.020255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.020678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.026196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:12.185081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:12.186209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:12.197944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.198855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.199684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.201310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.202131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.202885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.223430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:12.238809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e516c4c8-1e79-4182-88db-2a79202e0f0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.233777 Aug 31 12:35:12.239829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 843/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:12.384357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:12.385541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:12.396349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:12.396567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.397466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.398512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.399777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:12.400561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:12.401264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:12.407607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a5ac2ecb-ea6c-47c6-9f1d-586267c484b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.229378 Aug 31 12:35:12.408096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 865/1708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:12 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:12.486829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:12.497048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:12.499321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:12.500763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-659a216b-3bc9-4c7f-9bfe-5fd2c20e70b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123983 Aug 31 12:35:12.502176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 844/1709] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:13.269370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:13.270252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:13.279267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:13.279920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:13.280422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:13.281220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:13.281770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:13.282285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:13.304265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:13.442199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:13.443100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:13.452960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:13.453497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:13.454017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:13.454724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:13.455391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:13.455775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:13.463796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.474567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5bf3a5d2-b343-4bd1-b27e-77fe0cc65143 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.211646 Aug 31 12:35:13.475401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 866/1710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:13.533444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:13.534475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:13.545356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:13.546308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:13.547094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:13.548601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:13.549289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:13.550045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:13.652233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.663725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b40ed5ae-4b74-49c8-ae1f-bf852af32c3f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.225484 Aug 31 12:35:13.664410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 845/1711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:13 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:13.681889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.693915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.695556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:13.696908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc153bfa-0d12-401e-b96e-ae1936189969 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.172682 Aug 31 12:35:13.697543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 867/1712] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:14.500145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:14.501184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:14.517116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.517909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.518358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.519102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.519850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.520369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.689916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:14.692255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:14.702210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.702938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.703833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.704807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.705437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.705993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.725605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.741725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7554eef-d7c2-4928-8d50-c55953560c0f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.246778 Aug 31 12:35:14.743333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 846/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:14.752959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:14.754064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:14.765854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.766706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.767480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.768774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:14.769489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:14.770210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:14.891903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.903559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.905550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.906810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73189fb6-f188-46a4-a3ca-449329ce137f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.161498 Aug 31 12:35:14.907434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 847/1714] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:14.926477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:14.942496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-23169bfd-8b10-45d7-b431-822a175b0428 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.256507 Aug 31 12:35:14.943623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 868/1715] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:14 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:15.774311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:15.775310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:15.783174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.783705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.784146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.784867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.785319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.785739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.933795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:15.934695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:15.943019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.943650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.944307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.945076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:15.945535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:15.945957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:15.978973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:15.988945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9e0adf0b-eca4-4f7e-95ca-62bbff33120c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.219135 Aug 31 12:35:15.989537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 848/1716] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:15.994342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:15.994944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:16.001883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:16.002694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:16.003125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:16.003887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:16.004333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:16.004751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:16.032298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.047632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.050178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.051980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ce562809-1989-4632-a468-2304d147bd3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123755 Aug 31 12:35:16.052764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 869/1717] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:16.185656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:16.195874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d1c3a98a-b6d0-4ea5-a330-f672c9297455 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.204999 Aug 31 12:35:16.196468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 849/1718] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:15 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:17.021659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:17.022312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:17.030559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.031061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.031539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.032296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.032794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.033357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.079174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:17.079946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:17.088155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.088634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.089101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.089803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.090262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.090689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.180126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:17.194457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:17.197154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:17.199039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef96cd7e-9f53-4858-99ad-7c53aa330263 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124773 Aug 31 12:35:17.199985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 850/1719] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:17.223535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:17.224491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:17.224741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:17.235941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.236713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0668cfcb-89e3-42f2-af6a-58565bbe6359 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.218827 Aug 31 12:35:17.236902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.237556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.237742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 870/1720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:17.239090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:17.240035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:17.240807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:17.468103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:17.484604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84e0aa30-688a-4c35-9d23-a0c99cd230be tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.268610 Aug 31 12:35:17.485654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 851/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:17 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:18.229243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:18.229873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:18.238342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.238885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.239344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.240053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.240495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.240951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.263142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:18.263890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:18.271217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.271783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.272269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.273400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.273883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.274367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.353232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.369621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.371300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.373384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d5d9e1d2-2b2c-47a8-8baf-521f64d70242 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.148019 Aug 31 12:35:18.374030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 871/1722] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:18.491971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.501568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9fecd7bf-517b-49fb-b6a0-d32351a1a560 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.242770 Aug 31 12:35:18.502161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 852/1723] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:18.521670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:18.522299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:18.530118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.530637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.531074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.531859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:18.532310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:18.532733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:18.697878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:18.710386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-24d0584d-0eb9-4801-b680-77a9cf3dafda tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.193090 Aug 31 12:35:18.710963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 872/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:18 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:19.399453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:19.400204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:19.408970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.409517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.410006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.410835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.411484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.412021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.509995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.519942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.521413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.522956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-181f4fa5-5cac-4d5d-a93a-655367c44d6d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.127711 Aug 31 12:35:19.523567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 853/1725] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:19.531008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:19.532243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:19.544700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.545573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.546313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.547631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.548548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.549563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.716344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.725805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e85a0540-2ef4-4ad1-9acb-5a78d9ea547a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.202338 Aug 31 12:35:19.728202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 873/1726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:19.733193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:19.733806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:19.741366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.741900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.742342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.743074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:19.743584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:19.744007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:19.917215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:19.927974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-205245e3-dda7-4e65-8540-5de6544f13f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.198819 Aug 31 12:35:19.928805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 854/1727] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:19 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:20.570316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:20.571182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:20.580262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.580796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.581358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.582135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.582721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.583203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.670862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.681239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.683375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.684844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f3b7237-b810-4d27-9b6c-f9cfae896eaa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.119056 Aug 31 12:35:20.685477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 874/1728] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:20.754771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:20.755706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:20.762701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.763262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.763813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.764606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.765051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.767661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.955026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:20.955413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:20.956004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:20.964231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.964812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.965396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.966561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:20.967150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:20.967729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:20.968500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-05a8823e-57a3-4e31-ab39-662f41b66cd6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.217978 Aug 31 12:35:20.969195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 855/1729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:21.136689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.150216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1478b454-ab6b-4a50-8a42-a92e1694c7ee tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.200779 Aug 31 12:35:21.151376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 875/1730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:20 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:21.713267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:21.714332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:21.726237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.727197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.727989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.729266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:21.730057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:21.730813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:21.820525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.830714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.832406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:21.833808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-288fddd6-fd52-4b64-8673-5f1066a7eed7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.127544 Aug 31 12:35:21.834567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 856/1731] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:22.006701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.008068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.020051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.020940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.021707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.023342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.024487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.025232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.174311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.175135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.183561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.184365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.185040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.185987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.187032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.187507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.212878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.229066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66a5e881-ce1e-4182-ba17-6767a0f2319f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.229283 Aug 31 12:35:22.230525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 876/1732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:22.356960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.372570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-843c5846-0830-4aa3-aa94-a4c2fe2c14db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.202933 Aug 31 12:35:22.373650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 857/1733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:22 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:22.859707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:22.860383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:22.867939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.868438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.868851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.869601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:22.870047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:22.870466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:22.954680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.965014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.967863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:22.969078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ac6e4dd0-2b74-4669-9428-7b2b67b086d6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113735 Aug 31 12:35:22.969681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 877/1734] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:23.254224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:23.254923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:23.262759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.263289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.263763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.264496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.264951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.265379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.399066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:23.399894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:23.408882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.409499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.410744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.411742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:23.412454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:23.412959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:23.420842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:23.435611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-47be5cf8-5204-45bb-8326-e6b066036977 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.184983 Aug 31 12:35:23.436559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 858/1735] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:23.613321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:23.623842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8dc223ae-f557-4f98-8765-e31ff8a38166 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.230285 Aug 31 12:35:23.624609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 878/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:23 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:23.994584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:23.995265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:24.002747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.003401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.003936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.004730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.005247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.005719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.088552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.095431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:24.108436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.111390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.113543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bd38e4cf-b8a0-48cc-8b7f-5d3e8424e589 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123116 Aug 31 12:35:24.114626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 859/1737] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:24.460070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:24.460781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:24.470877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.472379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.472832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.473584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.474059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.474520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.633979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.643029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f63af10-97ba-425c-88ec-016f0166af68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.186972 Aug 31 12:35:24.644024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 879/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:24.655334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:24.656652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:24.670140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.671015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.671824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.673062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:24.673896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:24.674606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:24.864781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:24.874474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-91d7edfd-628e-45df-8d6b-01a36593bddb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.227629 Aug 31 12:35:24.875066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 860/1739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:24 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:25.152810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:25.153702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:25.160636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.161130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.161566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.162463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.163003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.163468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.253740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.266553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.268325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.269549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c375acf0-bc06-4342-9913-a52afacfe3a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.120881 Aug 31 12:35:25.270098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 880/1740] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:25.667928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:25.668735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:25.676496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.676893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.677324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.678357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.679004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.679774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.860281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:25.875944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-726c52e2-3464-4b1b-bf1b-57173ddedf02 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.212352 Aug 31 12:35:25.878133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 861/1741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:25.900487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:25.901165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:25.908996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.909490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.909923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:25.910630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:25.911077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:25.911541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.072962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:26.089494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea78496d-bd3a-4d31-bd91-2cbf971279c8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.195211 Aug 31 12:35:26.090265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 881/1742] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:25 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:26.298034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:26.299517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:26.311041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.311938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.312693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.313978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.314785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.315554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.415166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:26.425956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:26.427633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:26.428838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a0d2501-ebdf-433c-9a54-bacfa508a6ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.138277 Aug 31 12:35:26.429397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 862/1743] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:26.902661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:26.903614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:26.910824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.911354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.911782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:26.912486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:26.912947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:26.913467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.097994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.108101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f6f05d3-b840-486b-9175-dd9f6a9f2112 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.209339 Aug 31 12:35:27.108911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 882/1744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:27.126695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:27.127454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:27.135768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.136441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.137040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.138201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.139055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.139737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.301382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.311916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-464ebf2f-4e41-4996-ab17-83a92f658995 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.190405 Aug 31 12:35:27.312597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 863/1745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:27 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:27.454575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:27.455143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:27.462246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.462735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.463174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.463915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:27.464357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:27.464772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:27.469545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:27.560372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.570456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.571946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:27.573120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c53789de-46b4-4744-bec1-89163ff103d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123214 Aug 31 12:35:27.573693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 883/1746] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:28.131223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.131942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.140589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.141157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.141639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.142422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.142919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.143547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.308723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.318711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c403b73e-6eda-4206-9760-29a7f4028767 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.191448 Aug 31 12:35:28.319361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 864/1747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:28.334990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.335911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.344121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.344987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.345514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.346321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.346845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.347469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.502190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.512121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-80793583-c736-4689-8599-805d54ea1e26 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.181023 Aug 31 12:35:28.512953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 884/1748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:28.600520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:28.601278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:28.608778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.609332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.609810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.610686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:28.611265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:28.611746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:28.685883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.696481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.698000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:28.699198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f41f1126-1856-43ef-ba0f-ce272315407d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.105110 Aug 31 12:35:28.699792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 865/1749] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:29.361840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:29.362507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:29.370214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.370755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.371186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.372407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.372864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.373290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.537206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:29.538128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:29.546277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.546988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.547560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.548404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.548962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.549544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.557442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.568214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c25df78d-e171-47e8-a788-9f9a22684f5e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.210533 Aug 31 12:35:29.568897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 885/1750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:29.717556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.724753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:29.726033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:29.728747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-102417ed-895f-4f8b-b05f-ffe4615f0478 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.196381 Aug 31 12:35:29.729809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 866/1751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:29 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:29.734448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.735120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.735755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.736728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:29.737268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:29.737765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:29.809160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.819253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.820892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:29.822110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea700596-b765-49eb-bcf0-c778f89c45f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.102185 Aug 31 12:35:29.822730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 886/1752] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:30.601454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:30.602483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:30.614856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.615733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.616481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.617757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.618546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.619315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.755270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:30.756157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:30.765175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.765784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.766509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.767671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.768198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.768757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.802874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:30.818650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dce727c6-0739-40e5-975f-08610dff7458 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.224392 Aug 31 12:35:30.819704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 867/1753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:30.851016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:30.852306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:30.862880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.863797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.864564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.865840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:30.866650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:30.867461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:30.963722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:30.971036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:30.974921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:30.976562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:30.977826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f6ca06f0-3027-4a38-9f4a-edf4990b451c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.134237 Aug 31 12:35:30.978401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 868/1754] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:30.986935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22b0228e-7589-42f6-a0eb-c0dc6da40229 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.235942 Aug 31 12:35:30.988086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 887/1755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:30 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:31.853321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:31.854122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:31.856995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:31.864152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:31.864733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:31.865132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:31.866579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:31.867157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:31.867723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.006927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:32.008127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:32.012311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:32.024621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.025441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.026277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.028372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.029229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.029992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.055390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.065928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d4772f84-794f-4638-ab36-5e11ebc85f19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.216715 Aug 31 12:35:32.066653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 869/1756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:32.071770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:32.072410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:32.083616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.085538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.086688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.088732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:32.089439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:32.090134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:32.141367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.153002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.154651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.156220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bbf6003f-b615-4af3-8962-8a7fdd148449 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.156498 Aug 31 12:35:32.156912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 888/1757] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:32.276564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:32.287657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad7053e4-9a73-4c87-b60d-cf67102dbfaf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.219596 Aug 31 12:35:32.288257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 870/1758] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:32 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:33.099921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:33.100871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:33.111717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.112605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.113360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.114479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.114954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.115430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.186206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:33.187210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:33.194920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.195694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.196352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.197456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.198159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.199551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.307888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.318636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.320193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.322306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3cd0289b-6225-412c-91a2-5c0e08d5a788 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.142271 Aug 31 12:35:33.322306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 871/1759] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:35:33.327767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:33.328467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:33.335352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.335937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.336453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.337252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:33.337709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:33.339055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:33.355025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.370524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8cbeaea4-5f69-4f45-9eb8-804fa4f56a3b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.276645 Aug 31 12:35:33.372087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 889/1760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:33.506465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:33.516128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ba080c99-4aed-4e50-b722-775bfd209a2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.192782 Aug 31 12:35:33.516812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 872/1761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:33 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:34.355283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:34.356003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:34.364425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.366000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.366442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.367284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.367926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.368352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.404864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:34.405871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:34.416996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.417925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.418703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.420065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.420872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.421644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.459799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.471592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.474060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.476426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1fd7a8f4-320b-4082-96ab-a8a9d5aed939 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.125542 Aug 31 12:35:34.477687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 890/1762] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:34.545144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:34.546346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:34.558483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.559463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.560197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.561551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:34.562432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:34.563283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:34.600271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.609785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0fd2270-15ce-4b95-ad5a-8cb9752d47b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.210257 Aug 31 12:35:34.610380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 873/1763] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:34.777592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:34.789080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54cf7308-34fd-44de-a8b9-1f37921d8d41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.251617 Aug 31 12:35:34.789855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 891/1764] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:35.507030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:35.508055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:35.516234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.516870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.517467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.518274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.518828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.519444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.595187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:35.610795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:35.612279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:35.613500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3e92539a-3437-4fb6-aee7-53b858e9dbbc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.110988 Aug 31 12:35:35.614065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 874/1765] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:35.637520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:35.638485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:35.646505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.647490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.648069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.648972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.649522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.650048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.807543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:35.815460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:35.816674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:35.821737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f1199235-9b40-4a87-973c-26b4d3746b42 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.187991 Aug 31 12:35:35.822538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 892/1766] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:35.826235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.826984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.827558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.828378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:35.829015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:35.829795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:35.986086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:35.995173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bca1096d-f7f5-4a7b-a44f-86dce596d9f9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.186306 Aug 31 12:35:35.995804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 875/1767] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:35 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:36.638569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:36.639143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:36.646380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.646869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.647647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.648357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.648805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.649223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.722319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.731790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.733268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:36.734434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c3ec0206-db5f-420b-b9f9-48c72b6a24a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.100804 Aug 31 12:35:36.735036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 893/1768] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:36.846758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:36.847458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:36.854745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.855264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.855695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.856429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:36.856854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:36.857272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:36.881178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:37.016520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.021833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:37.023068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:37.030202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fba99646-3f06-4bfb-aec5-0c12af1e82ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.186906 Aug 31 12:35:37.031129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 876/1769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:37.031580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.032382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.032938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.033963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.034557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.035079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.201102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.210374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0f10caa-f3f0-47ac-bf2f-823f8459818d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.195858 Aug 31 12:35:37.210975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 894/1770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:37 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:37.758019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:37.758603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:37.767265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.767773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.768209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.768917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:37.769364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:37.769783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:37.846393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.857488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.859023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:37.860252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3be81e13-92aa-4244-85c4-116affefeacf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.106664 Aug 31 12:35:37.860824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 877/1771] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:38.059686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.060756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.072468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.075893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.077019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.080248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.082624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.083460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.233309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.234030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.242609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.243373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.244017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.245225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.246277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.246805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.318099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:38.327372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aafe381b-4651-48e2-95ce-5488965346e3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.275692 Aug 31 12:35:38.328297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 895/1772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:38.458528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:38.468545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f78862bc-c31f-42fd-9737-6b4c4d5fc019 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.240336 Aug 31 12:35:38.469153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 878/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:38.887844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:38.888558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:38.896668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.897803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.897913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.898646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:38.899201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:38.899977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:38.989231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.009419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.013202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.017731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ff68f6d-a607-4c3d-988a-27ab5ae776fd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.132603 Aug 31 12:35:39.018796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 896/1774] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:39.350898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:39.351608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:39.364268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:39.365347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:39.366113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.367491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:39.368336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:39.369090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.494262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:39.495314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:39.505078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:39.505797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:39.506565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.507455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:39.508003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:39.508541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:39.738774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.742950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:39.748799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2927e30-86b2-4954-b1b5-4acb562092c6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.401736 Aug 31 12:35:39.749408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 879/1775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:39.759010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85cb66c1-3e5a-4191-a08d-fb7ef91e4c87 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.269536 Aug 31 12:35:39.760047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 897/1776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:39 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:40.046048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:40.046655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:40.053377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.053869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.054299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.055010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.055497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.055922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.130173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:40.146973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:40.149064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:40.151160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-837154e4-18ca-4cb5-bbf0-70d35c71f5ef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.109126 Aug 31 12:35:40.152233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 880/1777] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:40.776688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:40.777382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:40.784917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.785385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.785845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.786529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:40.787116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.787116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.787519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:40.787735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.800218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.801105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.801909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:40.803158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:40.803999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:40.804749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:41.034607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.044729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-60d2e987-cbfe-4cae-935f-60c2b51199cb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.272614 Aug 31 12:35:41.045675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 898/1778] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:41.063980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.073104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9911fa7e-07b1-4016-9ee4-c6c526d7c14a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.293004 Aug 31 12:35:41.073662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 881/1779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:40 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:41.183371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:41.184161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:41.191063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:41.191561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:41.191987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:41.192691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:41.193131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:41.193655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:41.272928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.276453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:41.283481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.284833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:41.286030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c1cc817f-b113-4eaa-924e-b64131047ab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107082 Aug 31 12:35:41.286596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 899/1780] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:42.072615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:42.073279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:42.080508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.080999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.081415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.082110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.082582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.082995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.095531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:42.096154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:42.104630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.105152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.105725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.106482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.107061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.107621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.362380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.373005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b2e1e6bf-3a61-422f-9be5-ba56b02e81be tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.304132 Aug 31 12:35:42.373948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 882/1781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:42.379949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:42.381400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:42.387623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.388139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.388588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.389278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:42.389816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:42.390237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:42.400085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.409544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb73233e-74ec-420f-80a4-53f34131b7a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.317958 Aug 31 12:35:42.410140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 900/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:42 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:42.494890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.512284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.515476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:42.517731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-838c4bdc-f060-458e-99b5-93d50e3d6e74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.142215 Aug 31 12:35:42.518748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 883/1783] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:43.405201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:43.406117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:43.413069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.413564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.413998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.414717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.415173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.415699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.446216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:43.447075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:43.459032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.459867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.460637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.461907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.463007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.463801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.738448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.749398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2afa681a-a5a5-4515-b5c1-df89d78bf6fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.348385 Aug 31 12:35:43.749995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 901/1784] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:43.763068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:43.763743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:43.770507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.771433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.771947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.772977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:43.773425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:43.773832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:43.811076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.828175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a25e92e0-f600-41e3-8369-835061f677e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.386152 Aug 31 12:35:43.829882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 884/1785] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:43 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:43.846939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.863611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.866591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:43.868791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-988e53aa-9beb-4b66-b0e1-0fe41f8d24e8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.117515 Aug 31 12:35:43.869789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 902/1786] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:44.783562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:44.784598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:44.792090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:44.792646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:44.793224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.794180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:44.794786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:44.795424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.852387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:44.853090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:44.860849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:44.861344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:44.861782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.862496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:44.862947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:44.863403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:44.999135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.013277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1d571411-e658-47bf-9228-1dd10dde03b9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.233625 Aug 31 12:35:45.014302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 885/1787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:45.023622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:45.025624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:45.036326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:45.037075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:45.037837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:45.039932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:45.039932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:45.040465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:45.080448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.092413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09e94607-7d8b-4ced-9cc6-009ad281ca3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.244131 Aug 31 12:35:45.093022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 903/1788] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:44 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:45.118361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.128425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.129867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:45.131042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e84a5515-af72-4199-9b14-462b93b79a10 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.115399 Aug 31 12:35:45.131637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 886/1789] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:46.036822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:46.037507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:46.045759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.046249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.046678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.047427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.047871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.048288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.115448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:46.116307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:46.125127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.125797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.126370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.127131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.127617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.128040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.252169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:46.265763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb19f304-b18b-4b59-9094-2028ea617a30 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.232831 Aug 31 12:35:46.266653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 904/1790] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:46.272916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:46.273797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:46.282744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.283520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.283960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.284676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:46.285133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:46.285568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:46.332734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:46.343045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08cd22b4-3c53-49b1-9f5e-4c4a76b3e3ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.231899 Aug 31 12:35:46.343676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 887/1791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:46 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:46.362756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:46.372258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:46.373733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:46.374915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-720d88a0-6ceb-4878-ad47-ed92841b6bab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107095 Aug 31 12:35:46.375520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 905/1792] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:47.289242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:47.289932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:47.298296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.298793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.299252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.299977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.300426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.300893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.365747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:47.366868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:47.375589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.376141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.376544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.377417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.377861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.378399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.503429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.514355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6cc653c5-8de6-46bc-99f1-e484f24ffc43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.229089 Aug 31 12:35:47.514967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 888/1793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:47.519815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:47.520874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:47.528730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.529232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.529676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.530409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:47.531032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:47.531502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:47.569714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.585228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18454c48-29ba-44e6-ae14-c7a960d91246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.222665 Aug 31 12:35:47.586406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 906/1794] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:47 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:47.603370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.613900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.615494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:47.616820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11143644-5cbc-405e-b2a5-b463d1a212e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.100880 Aug 31 12:35:47.617447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 889/1795] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:48.547530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:48.548213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:48.555490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.556077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.556506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.557233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.557781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.558207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.613231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:48.613861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:48.621818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.622167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.622500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.623219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.623762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.624189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.793031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.809730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff0d4962-c48e-431f-8a91-54aaa4d3e20b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.266373 Aug 31 12:35:48.810782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 907/1796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:48.819922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:48.821003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:48.830564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.832368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.833206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.833971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.835255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:48.836076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:48.836896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:48.840642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5dd3bb48-a32f-4062-9ddf-8e35fca45ef3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.231516 Aug 31 12:35:48.841412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 890/1797] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:48 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:48.934242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.951151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.954015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:48.956229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b75cb30-83c4-4782-8aea-1985242b14a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.143613 Aug 31 12:35:48.957229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 908/1798] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:49.832511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:49.833305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:49.841895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.842448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.842993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.843829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.844377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.844937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.869826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:49.871027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:49.883712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.884582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.885379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:49.887515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:49.888384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:49.889180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:50.390400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.400873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5a630c8d-86ca-4d71-b856-ddbcbb97403a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.572672 Aug 31 12:35:50.401458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 891/1799] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:50.407365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.407654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:50.408116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:50.415123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:50.415726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:50.416241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:50.417100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:50.417677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:50.418304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:50.425519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d595b471-f3a7-49e5-a782-ead93a4b44a0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.562959 Aug 31 12:35:50.426696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 909/1800] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:49 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:50.503356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.513724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.515377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:50.516873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-01add129-9df1-4bac-b563-c2928ffbad5a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113699 Aug 31 12:35:50.517492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 892/1801] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:51.442471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.443608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.457601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.458821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.460047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.461561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.462402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.463168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.626405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.627534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.638149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.638959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.639501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.640276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.640996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.641682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.642359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.648392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:51.657722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-15334d6b-5736-4a08-b4e1-cad8f0fe07cd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.224181 Aug 31 12:35:51.658966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 910/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:51.667863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:51.668937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:51.681028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.682229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.683897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.684860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:51.685482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:51.686110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:51.768620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.779502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.780976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.782181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bd7ec827-9a02-444f-af8d-5c0785144f1e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.121923 Aug 31 12:35:51.782745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 911/1803] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:51.871611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:51.887455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c13368e1-a158-4b00-a848-32288bb728f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.441615 Aug 31 12:35:51.888198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 893/1804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:51 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:52.692005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:52.692621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:52.699785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.700283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.700709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.701413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.701864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.702297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.808881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:52.809968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:52.830720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.830720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.830720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.830720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.832762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.832762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.925396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:52.931342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:52.942150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d070343-baaf-4e8b-86f1-f2aeae807aaf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.254100 Aug 31 12:35:52.942921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:52.943729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 912/1805] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:52.946598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:52.950701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f03e822-8c88-47d4-abd5-f18bc4bc75b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.146747 Aug 31 12:35:52.951446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:52.952253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:52.960158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.960531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 894/1806] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:52.961157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.961599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:52.962315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:52.962764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:52.963181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.135984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:53.146066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ec307a5a-b0be-4751-8a6f-c2b9b6340594 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.200706 Aug 31 12:35:53.146778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 913/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:52 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:53.976883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:53.977741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:53.984806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.985254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:53.985760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.985760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.986306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:53.986460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.986859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.987297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:53.998024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:53.998892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:53.999722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.001014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.001844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.002632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.119431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.129628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.131187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.132433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72c6ec9f-bec1-4a48-a37b-df4e38927893 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.154797 Aug 31 12:35:54.133165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 914/1808] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:54.171335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:54.172087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:54.172196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.179191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.179843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.180274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.180982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:54.181428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:54.181850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:54.185666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-945351ec-8681-4568-9e23-bf78506853c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.212660 Aug 31 12:35:54.187934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 895/1809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:54.368747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:54.379124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f2d5f8a7-ec67-4691-963e-3203062cf141 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.213530 Aug 31 12:35:54.381855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 915/1810] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:54 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:55.172711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:55.173322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:55.181761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.182250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.182682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.183702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.184220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.184693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.212183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:55.213711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:55.227440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.228457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.229352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.232375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.233348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.234415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.266792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:55.305744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.317403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.318850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.322072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1acb384f-33aa-4fd1-a009-10de22fa582e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.152433 Aug 31 12:35:55.322072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 896/1811] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:55.403827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:55.405001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:55.413559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.414238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.414774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.415737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:55.416292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:55.416827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:55.458132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.467330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5556395-e3ec-4b8b-aa1f-1106cdd7ae98 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.260849 Aug 31 12:35:55.467934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 916/1812] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:55.603576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:55.613836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d4a2e17-e428-44c5-83e4-a86d435becc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.214552 Aug 31 12:35:55.613836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 897/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:55 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:56.346593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:56.347335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:56.354678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.355757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.356219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.358148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.359735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.360885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.442644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.452739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.454432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.455668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-74c393bf-3794-4e55-82cf-bbb97ac1b18c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113850 Aug 31 12:35:56.456249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 917/1814] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:56.491751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:56.492764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:56.501255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.502591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.502591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.502986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.503340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.503766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.637864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:56.638662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:56.645293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.645906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.646537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.647737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:56.648285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:56.648809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:56.665914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.677880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-34bf416d-bcd0-4725-86cb-ba436a9318c3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.190865 Aug 31 12:35:56.678642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 898/1815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:56.813259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:56.826272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b324e8b8-5672-433b-86b4-ce8faa9b4f1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.193242 Aug 31 12:35:56.826875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 918/1816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:56 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:57.480463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:57.480892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:57.487960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.488446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.488874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.489570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.490012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.490430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.563050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:57.577417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:57.578987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:57.580242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b825068-7d51-4e66-ba57-a5bc443bb00b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.104194 Aug 31 12:35:57.580825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 899/1817] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:57.701042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:57.701664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:57.708978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.709522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.709996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.710799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.711549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.712016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.853168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:57.854156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:57.861213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.861708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.862147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.862872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:57.863612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:57.863911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:57.889858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:57.900953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0bbae5a6-2d69-4873-bfc5-b97d6a594b88 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.203821 Aug 31 12:35:57.901843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 919/1818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:58.028359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:58.041356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f95d5442-547d-4d23-9393-0c67160047fc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.192432 Aug 31 12:35:58.041956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 900/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:57 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:58.604701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:58.605516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:58.613032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.613369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.613796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.614549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.615365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.615818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.692197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:58.701834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:58.703343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:58.704729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e8f2b8e-65ca-41c7-b5d3-4c9a52afc898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.104511 Aug 31 12:35:58.705836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 920/1820] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:35:58.924475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:58.925397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:58.932426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.933013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.933502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:58.934265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:58.934788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:58.935350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.065359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:59.066139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:59.075114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.076364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.076691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.077996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.079314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.079502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.116362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:59.127392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3d4b4b80-9544-4865-8052-ec66074f16dd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.208010 Aug 31 12:35:59.128245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 901/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:35:59.270052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:59.280286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2229d0e1-e052-4fbe-87bc-6323b5e9badb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.219553 Aug 31 12:35:59.280895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 921/1822] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:35:59 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:35:59.731620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:35:59.732391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:35:59.740267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.741015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.741591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.742479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:35:59.743129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:35:59.743671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:35:59.821875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:59.836058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:59.836058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:35:59.836058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57e82c55-c281-4405-89af-7818998c97b5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107646 Aug 31 12:35:59.836741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 902/1823] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:35:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:00.153245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:00.154106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:00.164864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.165481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.166003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.166989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.167554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.168413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.318672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:00.319852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:00.331901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.332791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.333635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.334889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.335749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.336491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.345407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:00.357750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-715341fe-d4e7-4a80-af9f-b92e7150bd68 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.209996 Aug 31 12:36:00.358362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 922/1824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:00.522648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:00.532580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-432037a2-1374-4fd3-bcb0-67e3ea5024d1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.221400 Aug 31 12:36:00.533166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 903/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:00 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:00.862384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:00.863570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:00.874891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.875830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.876586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.877843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:00.878699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:00.879481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:00.977144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:00.987483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:00.988947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:00.990161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b1e737d-d764-44de-903b-12041f2c0fa9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.135211 Aug 31 12:36:00.990755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 923/1826] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:01.381023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:01.381682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:01.389631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:01.390122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:01.390554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:01.391296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:01.391746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:01.392172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:01.553956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:01.555164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:01.556151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:01.564961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:01.565327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50093ad5-f119-4b5c-bac9-b8559fe17369 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.188108 Aug 31 12:36:01.566228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 904/1827] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:01.566393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:01.566773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:01.567822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:01.568420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:01.568955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:01.740367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:01.752068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f0854e1-1d52-4145-b4f9-4ac1af3149de tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.201708 Aug 31 12:36:01.752995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 924/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:01 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:02.030360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:02.030886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:02.032899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=72 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:02.038815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:02.039351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:02.039782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:02.040510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:02.040958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:02.041381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:02.113330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:02.123834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:02.125283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:02.126614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f730ef4-e70b-47d5-9b23-855c20c44c3f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.100612 Aug 31 12:36:02.127435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 905/1829] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:02.587736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:02.588415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:02.591125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=74 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:02.597149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:02.597640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:02.598078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:02.598841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:02.599294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:02.599748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:02.772408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:02.779258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:02.780333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:02.781782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a7e06e2c-857d-423a-87a6-b7433e31913a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.198210 Aug 31 12:36:02.782370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 925/1830] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:02.791403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:02.792283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:02.793014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:02.794248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:02.795038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:02.795876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:02.959348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:02.968846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bee73bd6-7b04-4539-b9f5-85a4f1da0f04 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.196900 Aug 31 12:36:02.969450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 906/1831] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:02 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:03.161570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:03.162678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:03.174197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:03.175030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:03.175786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:03.176984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:03.177780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:03.178548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:03.279277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:03.289332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:03.290800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:03.293205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0b15f7b-19c9-46cc-b923-e1927d450af6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.138266 Aug 31 12:36:03.293779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 926/1832] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:03.804310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:03.805023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:03.814156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:03.814652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:03.815080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:03.815838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:03.816288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:03.816715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:03.993149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:03.994024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:04.002118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:04.004386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:04.004823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:04.005114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:04.005449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c713294d-35f8-432c-ae93-3a843649fd34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.205174 Aug 31 12:36:04.005826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:04.006475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:04.006678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 907/1833] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:04.006870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:04.165737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:04.175690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a72319d-50cf-43b3-a534-99ef3a360f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.187254 Aug 31 12:36:04.176651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 927/1834] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:03 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:04.329796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:04.330403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:04.337657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:04.338117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:04.338615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:04.339417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:04.339877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:04.340293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:04.420560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:04.430327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:04.431717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:04.434224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-313c1d38-6f63-41e8-a69c-4721ef3f2342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107207 Aug 31 12:36:04.434224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 908/1835] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:05.028336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:05.028959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:05.035365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.035880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.036328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.037090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.037544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.037973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.198856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:05.199774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:05.205634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:05.207058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.207590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.208033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.208743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.209194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.209617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.220563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8453c33b-1b85-4392-a5d7-c20105539b04 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.195740 Aug 31 12:36:05.221675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 928/1836] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:05.370726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:05.377101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:05.387173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26aac124-2008-4606-a832-1600e05afb41 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.192503 Aug 31 12:36:05.387823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 909/1837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:05 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:05.456573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:05.457084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:05.463718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.464422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.465368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.465758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:05.466165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:05.466579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:05.543296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:05.553786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:05.555446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:05.556777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f3212f0-7e84-47ba-967c-ff87b65e29b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.104347 Aug 31 12:36:05.557412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 929/1838] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:06.246089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:06.246868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:06.255870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.256364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.256801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.257531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.257984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.258409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.409831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:06.410449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:06.418198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.418750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.419114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.419865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.420312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.420726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.422048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:06.432440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5f895faa-9b6f-4202-8ba0-09bab9f00f93 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.191830 Aug 31 12:36:06.434046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 910/1839] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:06.566779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:06.578174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ed091d9-6050-4cbe-8cef-37508c32ee58 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.172617 Aug 31 12:36:06.579214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 930/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:06 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:06.583011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:06.583883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:06.591403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.592040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.592476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.593188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:06.593645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:06.594273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:06.676409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:06.689150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:06.691115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:06.692404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-66bdf933-029d-4f6f-87cd-8546080fdcf3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.114563 Aug 31 12:36:06.693482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 911/1841] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:07.455848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:07.456868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:07.464781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:07.465376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:07.465810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:07.466502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:07.466948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:07.467427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:07.603613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:07.604789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:07.615577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:07.616414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:07.617061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:07.618016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:07.618856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:07.619700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:07.645081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:07.659457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0cbb5624-777e-4b79-b72e-4701fd8f660f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.207529 Aug 31 12:36:07.660415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 931/1842] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:07.720612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:07.721945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:07.734078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:07.734915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:07.735715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:07.737027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:07.737837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:07.738473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:07.835115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:07.843550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:07.846872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:07.848724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:07.850257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-183aff99-6ea2-44d9-8c65-65e204d99144 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.136913 Aug 31 12:36:07.850954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 932/1843] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:07.854183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-31e60cd1-0907-43f2-a173-ec9353aceded tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.255625 Aug 31 12:36:07.854873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 912/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:07 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:08.685964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:08.686598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:08.693814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:08.694280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:08.694728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:08.695485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:08.695936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:08.696361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:08.702346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:08.852474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:08.862400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fcf73e8f-a26e-480e-aa03-0b16ec3d201c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.180659 Aug 31 12:36:08.863417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 933/1845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:08.879011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:08.880327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:08.887612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:08.888314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:08.891972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:08.893266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:08.894033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:08.895305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:08.896109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:08.897496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:08.898975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:08.900014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:08.901266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:08.902394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:08.902985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:08.903572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:09.012514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:09.029418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:09.032270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:09.034444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b26b1753-0efd-44bd-b96f-eceb0bfe41f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.160543 Aug 31 12:36:09.035499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 913/1846] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:09.093037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:09.108925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d87283b-6b2b-4022-acb8-77c290bafc44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.227560 Aug 31 12:36:09.109855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 934/1847] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:08 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:09.884950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:09.885586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:09.893328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:09.893936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:09.894444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:09.895261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:09.896050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:09.896999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:10.046854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:10.056272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4e1e6a0-a099-4e46-9596-5bf4a3137e1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.175150 Aug 31 12:36:10.057027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 914/1848] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:10.074773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:10.075606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:10.082280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:10.082764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:10.083196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:10.083940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:10.084390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:10.084814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:10.134412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:10.136378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:10.147497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:10.148366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:10.149150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:10.150493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:10.151608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:10.152140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:10.155773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:10.166083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:10.167838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:10.169115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcde51c7-81fb-4e4a-b932-9a98c7c0c7a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.100860 Aug 31 12:36:10.169772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 935/1849] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:10.334116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:10.343444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eece5606-e27a-4957-a754-2ec8e414c052 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.214580 Aug 31 12:36:10.344024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 915/1850] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:10 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:11.082686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:11.083830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:11.095981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:11.096861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:11.097615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:11.099187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:11.100021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:11.100754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:11.210375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:11.211344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:11.219682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:11.220371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:11.220928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:11.221778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:11.222397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:11.233483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:11.269187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:11.284321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c79f41c7-8116-4986-b2f2-f23310039d7b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.208668 Aug 31 12:36:11.285253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 936/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:11.330617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:11.341355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:11.343072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:11.344337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9200e8cf-2737-4f1d-ad9c-370f1107a360 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.140768 Aug 31 12:36:11.344919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 916/1852] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:11.378335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:11.378958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:11.385612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:11.386969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:11.387590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:11.388494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:11.389048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:11.389565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:11.551847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:11.561697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-945421f2-df23-4d1f-96c9-4498c5f04993 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.187419 Aug 31 12:36:11.562316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 937/1853] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:11 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:12.318009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:12.318685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:12.326564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:12.327140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:12.327677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:12.328418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:12.328866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:12.329283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:12.372066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:12.373172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:12.383483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:12.384202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:12.384910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:12.386262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:12.387085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:12.387896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:12.492279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:12.502427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:12.503975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:12.505505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-87936f2f-a482-4dfa-bf6e-13dd8fa6475d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.140917 Aug 31 12:36:12.506088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 938/1854] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:12.536536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:12.546200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-383bf2d6-0a9a-4f23-9585-143d09ad41e0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.232082 Aug 31 12:36:12.546790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 917/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:12.584468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:12.585001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:12.592325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:12.592725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:12.593158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:12.593870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:12.594321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:12.594750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:12.757113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:12.766291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2b6053f-6d2c-41cf-8a2e-26eb0381055e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.185879 Aug 31 12:36:12.766858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 939/1856] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:12 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:13.530751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:13.531636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:13.539499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:13.539964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:13.540400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:13.541185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:13.541620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:13.542066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:13.570311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:13.571411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:13.584168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:13.585186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:13.585880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:13.587039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:13.587805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:13.588672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:13.629775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:13.647084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:13.649139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:13.651516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-17d5085f-e479-40df-9286-622bbf5bacf8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124620 Aug 31 12:36:13.652561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 918/1857] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:13.768962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:13.779044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ce9d1c85-eb6b-4fc8-9067-aac393bbc08a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.213973 Aug 31 12:36:13.779674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 940/1858] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:13.788357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:13.788880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:13.795988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:13.796484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:13.797039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:13.797811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:13.798259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:13.798678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:13.961703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:13.971961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd6bc24d-f5a8-445d-9643-42992c54930f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.187778 Aug 31 12:36:13.974060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 919/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:13 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:14.688805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:14.689433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:14.697210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:14.697964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:14.698526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:14.699331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:14.699836 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:14.700408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:14.770936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:14.781142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:14.782626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:14.783887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-307af3a2-6055-472f-b698-30531139ebe2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.099538 Aug 31 12:36:14.784459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 941/1860] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:14.801403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:14.802030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:14.809852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:14.810349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:14.810788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:14.811543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:14.811998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:14.812465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:14.973053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:14.982266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b88cde38-b16e-4484-8e8e-72e926d0f756 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.184849 Aug 31 12:36:14.982864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 920/1861] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:14.994907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:14.996027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:15.003139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:15.003666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:15.004096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:15.004809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:15.005258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:15.005715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:15.155107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:15.164703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a63f14a5-8f30-4240-9485-917a10d4b8b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.173860 Aug 31 12:36:15.165616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 942/1862] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:14 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:15.822438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:15.823161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:15.830899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:15.831510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:15.832003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:15.832789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:15.833283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:15.833745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:15.903025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:15.912632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:15.914247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:15.915559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c854f7fc-f4e3-4fe5-b026-2518a068a0a6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.097797 Aug 31 12:36:15.916102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 921/1863] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:16.004489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:16.005287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:16.013188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.017181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.017181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.017181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.017181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.017724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.184001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:16.189252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:16.189933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:16.194207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f185482b-a9ee-4df5-ae9a-6d76c5c13b92 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.193562 Aug 31 12:36:16.195006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 943/1864] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:16.197482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.198300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.198835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.199681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.200219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.200757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.366814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:16.383491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08d6233c-3330-46fa-81cf-e4777a0e0153 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.198169 Aug 31 12:36:16.384565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 922/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:16 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:16.945447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:16.945978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:16.952723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.953214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.953653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:16.954370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:16.954825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:16.955261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:17.031107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:17.040494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:17.042036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:17.043224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-edb6cd52-4452-47a0-9534-2e92de370cd0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.101938 Aug 31 12:36:17.043828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 944/1866] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:17.217503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:17.218063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:17.226679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:17.227559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:17.228076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:17.229047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:17.229609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:17.230097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:17.381256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:17.390596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c3fa73ae-23dc-40f9-b7ac-3219648e0210 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.177088 Aug 31 12:36:17.391191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 923/1867] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:17.418996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:17.420114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:17.430909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:17.431829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:17.432680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:17.433917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:17.434721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:17.435517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:17.624239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:17.634219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66b2afd5-e608-4412-8434-4cc6aff55917 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.223281 Aug 31 12:36:17.635062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 945/1868] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:17 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:18.066651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:18.067336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:18.074918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.075485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.075968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.076701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.077146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.077569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.154062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:18.164749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:18.166306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:18.167687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-783da292-0620-4140-92f4-537a0bcefa85 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.105176 Aug 31 12:36:18.168256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 924/1869] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:18.413667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:18.414328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:18.421731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.422246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.422650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.423420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.423849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.424291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.599722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:18.608758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f9e03a8-c590-4cdb-9e6e-ed2c21872a51 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.199516 Aug 31 12:36:18.609315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 946/1870] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:18.657121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:18.657755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:18.665180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.665575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.666020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.666807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:18.667257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:18.667926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:18.816204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:18.825653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f88d40e-8124-46dd-843d-30817db16abe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.172454 Aug 31 12:36:18.826347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 925/1871] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:18 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:19.207779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:19.208422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:19.215979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.216469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.216900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.217623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.218042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.218475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.288605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:19.298327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:19.299887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:19.301064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aebf1d9b-120b-42e9-a9f4-b9dcbb96f5d1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.097883 Aug 31 12:36:19.301630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 947/1872] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:19.632204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:19.633161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:19.642570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.643342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.644170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.645092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.645912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.646893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.672580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:19.813123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:19.822601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2375df96-5aad-4e58-a824-dcacdfee5a34 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.195800 Aug 31 12:36:19.823260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 926/1873] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:19.861376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:19.862067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:19.869318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.871070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.871577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:19.872353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:19.872812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:19.873231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:20.024029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:20.035124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2dfe6cc8-8bab-43fe-8121-3b198c032529 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.177530 Aug 31 12:36:20.035968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 948/1874] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:19 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:20.326073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:20.326594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:20.333542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:20.334039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:20.334477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:20.335251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:20.335720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:20.336145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:20.409911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:20.421250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:20.422821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:20.424018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-538143cd-5513-4455-bc9e-004524c041c3 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.102597 Aug 31 12:36:20.424581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 927/1875] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:20.857954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:20.858562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:20.865979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:20.866747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:20.866861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:20.867614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:20.868062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:20.868480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.012803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:21.016949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:21.023581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a38cc4e9-c116-4726-8a73-61e0e8dd68ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.170255 Aug 31 12:36:21.024155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 949/1876] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:21.058331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:21.058968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:21.065932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:21.066418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:21.066845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.067593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:21.068177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:21.068595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.248956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:21.258452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-376bd421-034f-4f90-ae50-ac730e5db24c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.203940 Aug 31 12:36:21.259123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 928/1877] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:21 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:21.448816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:21.449578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:21.456160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:21.456650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:21.457079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.457814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:21.458254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:21.458671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:21.530236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:21.546974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:21.548473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:21.549749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-01cc14e6-c4b3-4162-ac69-f2b01be117ec tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.104918 Aug 31 12:36:21.550481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 950/1878] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:22.045955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:22.046737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:22.054340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.055326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.055540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.056165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.056622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.057040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.227481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:22.242804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fcef5e3b-4a5a-420d-af53-f3a4e94a5698 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.201073 Aug 31 12:36:22.243911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 929/1879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:22.285298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:22.286092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:22.294261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.294757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.295199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.295941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.296390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.296808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.464507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:22.480169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dac73432-c773-4981-92e5-239653782ab0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.198514 Aug 31 12:36:22.481256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 951/1880] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:22 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:22.575375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:22.576182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:22.583670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.584297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.584832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.585816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:22.586407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:22.586938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:22.669714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:22.679275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:22.680693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:22.682026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b8dcd8a-9bd4-487a-a7f6-ae646303b8fa tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.111323 Aug 31 12:36:22.683459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 930/1881] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:23.274857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:23.275498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:23.285082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:23.285924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:23.286692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:23.287985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:23.288771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:23.289520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:23.459763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:23.470301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c1d983f1-7a6b-4e9e-8158-ad708ff8bfbc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.199732 Aug 31 12:36:23.470871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 952/1882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:23.504996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:23.505767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:23.513424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:23.513916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:23.514381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:23.515101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:23.515605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:23.516019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:23.689855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:23.700754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7cce935f-bb63-4731-8cc5-731d2ff9e7e7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.199966 Aug 31 12:36:23.701473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 931/1883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:23 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:23.712705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:23.715360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:23.728107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:23.729802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:23.730654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:23.732011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:23.732833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:23.733595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:23.816174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:23.832923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:23.835933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:23.838200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-349fa07c-4810-452a-aa7c-91a54b87f7a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.133128 Aug 31 12:36:23.839434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 953/1884] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:24.495726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:24.496355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:24.505875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.506672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.506930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.507753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.508362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.508834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.718569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:24.726589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:24.727644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:24.732991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0a4bf6da-3372-4a7d-be4e-497e8451c043 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.241934 Aug 31 12:36:24.734522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 932/1885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:24.739743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.740711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.741497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.742767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.743706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.745185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.881038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:24.881759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:24.893007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.894080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.894814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.896415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:24.897221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:24.897956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:24.931003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:24.940443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd328e6f-c898-4679-9c7e-17c2c7b2ad5d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.220906 Aug 31 12:36:24.941039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 954/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:24 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:24.995657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:25.005853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:25.007486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:25.008685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab9102af-a398-4085-b0c7-7a1ca4b2f291 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.134255 Aug 31 12:36:25.009254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 933/1887] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:25.757310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:25.757944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:25.765594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:25.766140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:25.766613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:25.767505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:25.768167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:25.768660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:25.943062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:25.952350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-823a3200-bab3-4223-b0a3-7e3483ecc33d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.199311 Aug 31 12:36:25.952922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 955/1888] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:25.969111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:25.970337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:25.982531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:25.983384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:25.984114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:25.985390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:25.986235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:25.987298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:26.037022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:26.038086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:26.048530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:26.049039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:26.049481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:26.050228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:26.050716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:26.051098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:26.137336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:26.150012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:26.153784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:26.155281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f5e5bc28-fd39-411e-8070-8356eade58cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.125784 Aug 31 12:36:26.156050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 956/1889] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:26.187107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:26.196429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ef61703-b947-4fe0-a47f-3314e3c4495e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.236014 Aug 31 12:36:26.197681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 934/1890] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:25 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:26.975796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:26.976624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:26.985271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:26.985758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:26.986194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:26.986913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:26.987397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:26.987830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.158803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:27.168351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4a2689a7-bd0d-4d3c-95cf-cd862bf23154 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.196782 Aug 31 12:36:27.168950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 957/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:27.182311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:27.183400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:27.194942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.195923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.196664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.197894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.198628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.199098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.218906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:27.219746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:27.227164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.227837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.228344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.230028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:27.230567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:27.231105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:27.304600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:27.322074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:27.325294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:27.327670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83a8bb82-64d8-4a12-adc7-a350e1e26111 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.150000 Aug 31 12:36:27.328717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 935/1892] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:27.444889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:27.455979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1694dcf6-81e3-402b-b6ec-8fbcff03124e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.241089 Aug 31 12:36:27.456792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 958/1893] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:27 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:28.192686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:28.193667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:28.202257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.202877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.203565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.204618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.205116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.205551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.355642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:28.356512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:28.364758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.365425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.365964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.366985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.367813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.368452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.389249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:28.401757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b175cef-5128-4fbc-8972-f549b38e7414 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.213417 Aug 31 12:36:28.402455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 936/1894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:28.462460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:28.472704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:28.474213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:28.475518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c16e002f-7f30-4be1-8699-1cfa95d9205a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124542 Aug 31 12:36:28.476089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 959/1895] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:28.478291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:28.479275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:28.485607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.486100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.486535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.487258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:28.487724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:28.488149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:28.636283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:28.645534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e3c2994b-9f3f-4c53-bc83-1b2e1ec7944d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.171159 Aug 31 12:36:28.646474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 937/1896] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:28 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:29.435271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:29.436304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:29.444380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:29.444942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:29.445480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:29.446211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:29.446659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:29.447081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:29.505326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:29.506900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:29.518564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:29.519597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:29.520437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:29.522398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:29.523357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:29.524264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:29.642257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:29.649437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:29.661226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf7a70dc-8108-41e7-a9ea-44ed98116021 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.230768 Aug 31 12:36:29.661783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:29.661935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 960/1897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:29.665313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:29.668087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-96c9263b-d653-41f0-aa4b-3668bb2e1fc9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.170609 Aug 31 12:36:29.669203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 938/1898] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:36:29.670534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:29.671253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:29.677967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:29.678837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:29.679522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:29.680487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:29.681158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:29.682021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:29.847453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:29.862308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8c968fcc-c305-4c37-ab2e-f669eff35fd5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.196236 Aug 31 12:36:29.862963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 961/1899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:29 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:30.692784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:30.693368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:30.696573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:30.697913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:30.701422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.701917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.702342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.703343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.703806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.704216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.706410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.707067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.707677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.708612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.709224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.709786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.801977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:30.815330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:30.817083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:30.818477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-01086c92-a900-4174-8c4b-fe7dc0f7f9ca tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.129795 Aug 31 12:36:30.819055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 939/1900] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:30.884916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:30.885772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:30.896713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.897476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.898117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:30.898340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.899382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:30.900148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:30.901284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:30.910652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5ed57fb2-ae69-40d1-84a2-caddd1a8b51f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.218102 Aug 31 12:36:30.911485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 962/1901] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:31.072194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:31.082159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-47572ac9-d928-4917-a261-3f9f352cf2cc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.201238 Aug 31 12:36:31.082770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 940/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:30 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:31.857877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:31.858762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:31.866278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:31.866768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:31.867196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:31.867946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:31.868394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:31.868812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:31.934414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:31.935471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:31.943128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:31.943435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:31.943961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:31.944584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:31.944807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:31.945140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:31.945571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:31.957844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:31.960646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:31.962648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b49b2ef-152a-448b-8d5c-27c182e9230e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.110494 Aug 31 12:36:31.963643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 963/1903] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:32.103940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:32.106927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:32.107596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:32.114208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:32.114509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb34c65b-f85f-49d8-8fa8-9460a7bbcdb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.184783 Aug 31 12:36:32.114738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:32.115007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:32.115451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 941/1904] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:32.115828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:32.116289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:32.116710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:32.291323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:32.301938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1ec4591a-0270-488a-8656-2dee0df403fa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.199396 Aug 31 12:36:32.302822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 964/1905] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:32 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:33.002082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:33.002782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:33.005105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=74 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:33.011797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:33.012291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:33.013028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:33.013756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:33.014205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:33.014630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:33.087966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:33.097977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:33.099755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:33.101184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-934c3d02-324a-437d-94e9-9ed9805e917b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.103399 Aug 31 12:36:33.101829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 942/1906] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:33.151538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:33.152186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:33.154529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=80 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:33.161560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:33.162107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:33.162583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:33.163487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:33.164083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:33.164585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:33.336376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:33.337104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:33.346973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:33.347844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:33.348069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:33.348530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:33.349691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:33.350470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:33.351146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:33.357779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:33.363467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1d53ed35-cd60-492e-a56c-9cc4ccc875e8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.216819 Aug 31 12:36:33.364957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 965/1907] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:33.511017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:33.520253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-59154333-5dd6-4453-b9ec-1e6631820654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.188742 Aug 31 12:36:33.520849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 943/1908] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:33 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:34.126299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:34.126979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:34.134907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:34.135788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:34.136296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:34.137031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:34.137500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:34.137929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:34.159610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:34.211278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:34.222038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:34.223550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:34.224762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0365c4c-2dd6-42c9-9f19-d4b1082cfd1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.103244 Aug 31 12:36:34.225344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 966/1909] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:34.388877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:34.389842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:34.397969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:34.398602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:34.399145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:34.400006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:34.400640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:34.401160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:34.545984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:34.546805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:34.559409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:34.560279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:34.561040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:34.562348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:34.563170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:34.563946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:34.578663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:34.591700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b1ddeaac-b839-4577-a1bb-9a8854f2ccf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.208756 Aug 31 12:36:34.593244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 944/1910] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:34.743464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:34.754567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b87b6a0-6ca2-4640-96ea-f9e58c0c7842 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.215649 Aug 31 12:36:34.755151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 967/1911] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:35.249495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:35.250194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:35.257943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:35.258484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:35.258953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:35.259794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:35.260282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:35.260920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:35.339912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:35.350607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:35.352167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:35.353775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf497612-4834-4769-8993-425f268fa4d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.108416 Aug 31 12:36:35.354351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 945/1912] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:35.629217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:35.629838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:35.637608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:35.638096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:35.638523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:35.639277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:35.639725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:35.640141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:35.784541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:35.785667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:35.797391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:35.798265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:35.799089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:35.800504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:35.802000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:35.802247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:35.821574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:35.832495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-147b739a-d795-4c54-8dfe-e58a94b55ee5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.207261 Aug 31 12:36:35.834336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 968/1913] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:35.978900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:35.989364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-58089f78-42f3-4e27-a450-0ff5ced8f747 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.213027 Aug 31 12:36:35.990110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 946/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:35 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:36.381728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:36.382415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:36.392707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.393363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.393902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.395642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.395642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.396530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.472812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:36.483177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:36.484860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:36.486294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6deb1610-2f85-4cef-8a3e-420e240e2fd4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.109189 Aug 31 12:36:36.486927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 969/1915] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:36.868986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:36.870392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:36.877871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.878639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.879194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:36.880166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:36.880762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:36.881289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.013883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:37.014793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:37.022801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:37.023340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:37.023903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.024641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:37.025242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:37.025781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.063327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.074319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7358d569-a5f4-4561-8280-7a86c5706214 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.209485 Aug 31 12:36:37.087268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 947/1916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:37.212953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.222832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-133a91d5-3c92-4f16-ba06-dc7ee58259a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.214244 Aug 31 12:36:37.223480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 970/1917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:37 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:37.513997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:37.514500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:37.521869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:37.522534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:37.523185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.524348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:37.524835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:37.525459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:37.603857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.613898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.615437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:37.617126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fee8e4e3-68d6-4ce8-9c24-7bbed0ce6f33 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107152 Aug 31 12:36:37.617780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 948/1918] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:38.099690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:38.100694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:38.111847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.112478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.113323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.114515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.115278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.116014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.250247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:38.251274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:38.260614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.260614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.261317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.262500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.263130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.263747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.299991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:38.311381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7cf7f675-fb2d-4f0e-98b9-ee0d3daf0608 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.217560 Aug 31 12:36:38.312138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 971/1919] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:38.471190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:38.484100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3173f6d9-c062-469c-8ece-059b4f887012 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.240146 Aug 31 12:36:38.484677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 949/1920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:38.643380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:38.644264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:38.652723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.653271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.653808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.654579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:38.655166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:38.655740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:38.743687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:38.755171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:38.757871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:38.758189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-722d120d-5e55-4fb5-b665-208a653fe3d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.119491 Aug 31 12:36:38.758988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 972/1921] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:39.336463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:39.337144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:39.345124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:39.345747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:39.346292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:39.347139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:39.347729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:39.348250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:39.515563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:39.516881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:39.529542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:39.530460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:39.531371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:39.532721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:39.533630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:39.534455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:39.554418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:39.568953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d38979c4-7ff8-429f-87db-137158b091c4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.236275 Aug 31 12:36:39.569847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 950/1922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:39.738473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:39.754504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a94aeaa7-4f39-4c3a-8495-3270cd688f66 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.246514 Aug 31 12:36:39.755698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 973/1923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:39 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:39.802864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:39.803757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:39.813293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:39.813881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:39.814443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:39.815528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:39.816320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:39.816799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:39.908123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:39.918797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:39.920910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:39.922262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c4fb465c-9141-4155-812f-37db22cfc2c2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123661 Aug 31 12:36:39.922927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 951/1924] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:40.605067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:40.605976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:40.615523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:40.616399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:40.617210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:40.618481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:40.619499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:40.620532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:40.785528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:40.786629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:40.797188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:40.797752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:40.798284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:40.799310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:40.800019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:40.800685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:41.149533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:41.154683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:41.161230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-830b669d-05ce-40cb-9f07-1a7e8cbec4a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.561246 Aug 31 12:36:41.162042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 974/1925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:41.167964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7614894b-fbca-4f33-973a-62f3f63b4e83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.388774 Aug 31 12:36:41.169760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 952/1926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:40 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:41.172097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:41.173338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:41.186280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:41.187401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:41.188274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:41.189622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:41.190155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:41.190701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:41.279954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:41.293865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:41.296861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:41.299382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ece6a388-73bc-4022-982e-72fc06d41c96 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.135701 Aug 31 12:36:41.300197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 975/1927] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:42.199900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:42.200848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:42.208776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:42.209846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:42.210041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.210561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.211270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.212125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.212866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.213883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.222448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.223276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.224034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.225299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.226070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.226826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.477064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:42.491105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:42.492497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-309e6469-53e1-4e10-a4af-9f533cd5ae29 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.298608 Aug 31 12:36:42.495353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 953/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:42.503801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:42.504266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70221dd0-d0da-4fb0-8fa6-a0173459314b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.303104 Aug 31 12:36:42.504948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:42.510313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 976/1929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:42 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:42.518785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.519801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.520545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.521798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:42.522333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:42.522928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:42.608055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:42.623845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:42.626542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:42.628631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac3e2fa4-336a-4bc4-9b1c-5c2569b9ee76 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.132066 Aug 31 12:36:42.629624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 954/1930] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:43.530446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:43.531292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:43.531627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:43.532660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:43.538814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:43.539352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:43.539786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:43.540749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:43.541361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:43.542046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:43.542375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:43.543185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:43.543943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:43.545117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:43.545760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:43.546403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:43.761103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:43.771817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11286416-72e8-43a0-b145-b81a543b49a1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.245488 Aug 31 12:36:43.772729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 955/1931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:43 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:43.777641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:43.779816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:43.780697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:43.788667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:43.789366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:43.789802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:43.790577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:43.791008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:43.791466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:43.792125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a8cd8018-7b0d-42ee-82e5-c7ff5cf839e2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.266805 Aug 31 12:36:43.793058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 977/1932] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:43.864068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:43.874148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:43.875354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:43.876678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28239086-4ff9-43c8-b9d4-ed237c0369d5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.102750 Aug 31 12:36:43.877133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 956/1933] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:44.795169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:44.796093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:44.803527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:44.804049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:44.804466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:44.805191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:44.805645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:44.806292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:44.821944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:44.823295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:44.835720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:44.836706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:44.837574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:44.838948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:44.840126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:44.841334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:45.097277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:45.106890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de453873-0244-40fd-9225-efef5810b69d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.315856 Aug 31 12:36:45.107542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 978/1934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:44 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:45.112495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:45.113116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:45.121094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:45.121581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:45.122245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:45.122986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:45.123492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:45.123910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:45.173180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:45.182527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50859e31-a460-4adf-8ad3-2be4c05feea7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.368207 Aug 31 12:36:45.183134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 957/1935] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:45.220692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:45.235896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:45.237393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:45.238607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d75e3d51-a7ba-44bc-b3e3-b4be95e70110 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.130124 Aug 31 12:36:45.239178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 979/1936] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:46.150743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:46.151458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:46.160085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.160588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.161030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.161784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.162229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.162645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.210106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:46.211477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:46.223887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.224762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.225504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.226665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.227736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.228622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.376742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:46.388622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-982ae744-1be2-41d4-b003-07acc161ccf8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.243170 Aug 31 12:36:46.389756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 958/1937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:46 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:46.400837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:46.402111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:46.411689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.412750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.413358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.414324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:46.415048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:46.416702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:46.449902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:46.465393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-820dbd01-0ee6-433d-9f89-ec2459207de3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.262447 Aug 31 12:36:46.466481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 980/1938] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:46.488956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:46.492840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:46.500184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:46.501649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:46.502958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-691f0026-d39c-4b0d-9342-bc52a57d416c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.111488 Aug 31 12:36:46.503444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 959/1939] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:47.425214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:47.426027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:47.435435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:47.436140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:47.436616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:47.437353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:47.437920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:47.438458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:47.488995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:47.489794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:47.500096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:47.500940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:47.501723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:47.503091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:47.504061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:47.504781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:47.687156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:47.697614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41e8e03a-0332-48cb-b425-d509e355fae2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.277008 Aug 31 12:36:47.698379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 981/1940] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:47 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:47.703397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:47.704006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:47.713833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:47.714341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:47.714837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:47.715538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:47.716162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:47.716591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:47.735948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:47.749314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-df0134e3-3294-4b81-b82e-490e1f94f3bd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.264648 Aug 31 12:36:47.749891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 960/1941] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:47.798217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:47.811539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:47.813797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:47.815562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c5801e8-35f3-4b87-91b9-e4bfa45b5443 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.115969 Aug 31 12:36:47.816233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 982/1942] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:48.723538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:48.724549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:48.733260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:48.733804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:48.734247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:48.734974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:48.735469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:48.735897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:48.772786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:48.773890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:48.788597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:48.792054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:48.793644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:48.795495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:48.796390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:48.797120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:48.811285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:36:48.969651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:48.980743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13270b8e-a634-45ce-aae5-1a2217cdcd15 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.261513 Aug 31 12:36:48.981455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 961/1943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:48 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:48.990831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:48.992039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:49.001806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:49.002377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:49.002734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:49.003507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:49.003967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:49.004390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:49.011326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:49.023976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a88dcf77-1ae9-4e5a-a095-2274ccbc1d46 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.256179 Aug 31 12:36:49.025765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 983/1944] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:49.079392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:49.089976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:49.091613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:49.092863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2a64b8a7-308b-4f06-80b6-2edd7b2f09f2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.109754 Aug 31 12:36:49.093524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 962/1945] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:50.013120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:50.013993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:50.022385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:50.022878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:50.023351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:50.024069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:50.024564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:50.024979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:50.054431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:50.055503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:50.067423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:50.068199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:50.068899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:50.070083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:50.070830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:50.071583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:50.283746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:50.288784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:50.298443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-904fda6a-edec-4cb9-963e-15e18184aa9d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.289228 Aug 31 12:36:50.299564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 984/1946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:50 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:50.308225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:50.309532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:50.312602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b6fa993-b143-43da-93ef-d74512bd654b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.264596 Aug 31 12:36:50.313822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 963/1947] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:50.319225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:50.319772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:50.320183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:50.320943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:50.321884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:50.322323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:50.408325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:50.419015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:50.420525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:50.421780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-550a85f7-47c8-4b1a-bd19-f83c2f15bcaf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.120867 Aug 31 12:36:50.422438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 985/1948] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:51.327763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:51.328640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:51.336593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:51.337075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:51.337591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:51.338404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:51.338935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:51.339486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:51.345935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:51.347071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:51.357007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:51.357496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:51.357942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:51.358655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:51.359099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:51.359561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:51.572145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:51.582211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac5f99af-3111-413b-a01d-97d7764a0d31 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.259386 Aug 31 12:36:51.582915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 964/1949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:51 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:51.583725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:51.589150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:51.589652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:51.596224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:51.597014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:51.597642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:51.598554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:51.598990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:51.599617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:51.601975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-891e6a64-2bbd-491a-be21-c6fc37a329ab tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.264483 Aug 31 12:36:51.603137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 986/1950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:51.668623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:51.678662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:51.680158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:51.681453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c5ebbfd-f1c1-45c3-a795-7a7af1894abb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.097556 Aug 31 12:36:51.682029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 965/1951] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:52.610483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:52.611173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:52.618702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:52.619349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:52.619793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:52.620492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:52.621061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:52.621435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:52.641369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:52.642487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:52.655293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:52.656210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:52.656987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:52.658233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:52.659096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:52.659893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:52.842567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:52.858516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-46cd00d8-79e5-4a64-bf7b-3da430a71f2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.251654 Aug 31 12:36:52.859607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 987/1952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:52 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:52.865482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:52.866278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:52.875447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:52.876193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:52.876853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:52.877981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:52.878765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:52.879376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:52.901703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:52.911389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec832f46-ae7c-4be7-b170-a711985bc8ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.277579 Aug 31 12:36:52.912118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 966/1953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:52.955749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:52.965275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:52.966753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:52.968025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e8e5751-6a06-41df-afbf-5490ebd0acdd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107207 Aug 31 12:36:52.968611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 988/1954] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:53.881979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:53.882660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:53.891803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:53.892654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:53.893201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:53.894141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:53.894804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:53.895423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:53.934270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:53.935147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:53.943594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:53.944184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:53.944705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:53.945442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:53.945895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:53.946375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:54.198618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:54.208119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aab287a1-8509-4859-b44d-b79c72bcbcfa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.330387 Aug 31 12:36:54.209053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 967/1955] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:53 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:54.213747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:54.214419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:54.215482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:54.221429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:54.221902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:54.222573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:54.223286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:54.223912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:54.224327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:54.226410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e34a491f-38a5-41de-8876-0417db776792 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.296664 Aug 31 12:36:54.227097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 989/1956] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:54.297752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:54.307282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:54.308720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:54.309908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0544b568-0e4b-435d-b95f-a2bfb9c6c192 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.100193 Aug 31 12:36:54.310501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 968/1957] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:55.241280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:55.242086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:55.249863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:55.250225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:55.250992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:55.251200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:55.251428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:55.251615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:55.251940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:55.252368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:55.260277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:55.260928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:55.261463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:55.262457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:55.263031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:55.263674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:55.577176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:55.587198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-86cc12ae-8845-4890-83f4-4a67615ea064 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.341748 Aug 31 12:36:55.588265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 969/1958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:55.592032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:55.597781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:55.601021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:55.601454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd218ab8-39ef-44a0-ba9b-01aa4f747be5 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.364077 Aug 31 12:36:55.602070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 990/1959] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:55 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:55.612731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:55.613564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:55.614357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:55.615639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:55.616435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:55.617158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:55.692496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:55.707719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:55.709432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:55.710649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c86d682a-f344-48b1-a8c3-f703397e5748 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.120452 Aug 31 12:36:55.711199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 970/1960] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:56.610068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:56.610754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:56.618108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:56.618912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:56.619449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:56.620206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:56.620638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:56.621062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:56.628028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:56.629524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:56.641286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:56.642166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:56.642862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:56.644224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:56.645065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:56.646105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:56.832795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:56.844196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-da4b0f1c-a14b-4736-91e5-903f819c090d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.237928 Aug 31 12:36:56.845099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 991/1961] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:56.850640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:56.851278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:56.858892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:56.859426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:56.859980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:56.860596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:56.861051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:56.861492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:56.877700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:56.889259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7019156-927c-43eb-a476-cd60c5065d80 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.268276 Aug 31 12:36:56.890413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 971/1962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:56 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:56.934546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:56.944838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:56.946385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:56.947880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-680a86d4-d1d4-4348-b3d8-5c70357eef2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.101701 Aug 31 12:36:56.948569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 992/1963] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:57.866260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:57.867045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:57.874618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:57.875106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:57.875585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:57.876315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:57.876771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:57.877206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:57.924964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:57.925640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:57.933542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:57.934018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:57.934494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:57.935215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:57.935703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:57.936130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:58.226124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:58.232936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:58.237039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25452444-224a-47d9-a395-891a006643f5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.374660 Aug 31 12:36:58.237709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 972/1964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:58.244060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:58.244805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:58.251414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:58.251898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:58.252362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:58.253008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c71dcdd4-40b2-4499-bda6-ec0ad8d85250 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.331554 Aug 31 12:36:58.253153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:58.253515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:58.253935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:58.254090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 993/1965] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:57 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:58.332110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:58.348590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:58.351410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:58.353589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-821781e0-b9ca-40da-9b18-538b56d68653 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.114465 Aug 31 12:36:58.354570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 973/1966] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:36:59.259871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:59.260546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:59.268129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:59.268771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:59.269315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:59.270139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:59.270999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:59.271554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:59.289948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:59.290948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:59.298555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:59.299038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:59.299616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:59.300378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:59.300820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:59.301236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:59.499463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:59.511913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eea15fa1-56d5-49a1-8226-cb5702ce030b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.256259 Aug 31 12:36:59.512872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 994/1967] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:36:59.515695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:59.521050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:36:59.522698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:36:59.532896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-efb559ca-39eb-424e-8261-b27fd4f09c2c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.245118 Aug 31 12:36:59.533215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:59.534049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:59.535086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:59.535348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 974/1968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:36:59 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:36:59.536872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:36:59.537724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:36:59.538494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:36:59.628955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:59.639429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:59.641399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:36:59.642421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3886a11b-2fce-4e6d-a953-c5765a9c2a78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.128082 Aug 31 12:36:59.643096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 995/1969] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:36:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:00.541776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:00.542457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:00.550082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:00.550720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:00.551313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:00.552152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:00.552707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:00.553228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:00.570612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:00.573571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:00.581109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:00.581712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:00.582218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:00.582969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:00.583467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:00.583895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:00.792355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:00.798899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:00.808529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e51b9079-4407-4aad-8f3c-684f0f2e67b6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.270866 Aug 31 12:37:00.809081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b218377c-4dfd-4500-932e-8e7fea614777 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.242928 Aug 31 12:37:00.809579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 975/1970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:00.809766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 996/1971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:00 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:00.818284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:00.819448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:00.830713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:00.831603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:00.832373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:00.833610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:00.834425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:00.835164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:00.871313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:00.936412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:00.946154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:00.947694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:00.948873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3f2d98a0-6257-487e-923c-16471b997142 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.137945 Aug 31 12:37:00.949435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 976/1972] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:01.835013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:01.835900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:01.836561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:01.836848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:01.848758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:01.849135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:01.849555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:01.849724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:01.850298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:01.850469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:01.851453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:01.851662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:01.852293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:01.853610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:01.853610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:01.854047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:02.098802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:02.109819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7921c63-368a-43d6-8c09-4648679ca4e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.281060 Aug 31 12:37:02.110557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 977/1973] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:02.116358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:02.119200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:02.120682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:02.131727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:02.132052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6df5cd12-c59d-4d57-a42f-16f4e68a836c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.302993 Aug 31 12:37:02.133081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 997/1974] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:01 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:02.142919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:02.142919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:02.142919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:02.142919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:02.143400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:02.212407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:02.222435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:02.224194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:02.225574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-895e2681-9779-4ca5-9189-065ebc843a44 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113611 Aug 31 12:37:02.226368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 978/1975] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:03.148301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:03.149022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:03.156339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.156841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.157279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.158001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.158451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.158870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.172023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:03.173125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:03.176455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=74 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:03.185716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.186566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.187362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.188632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.189424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.190183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.355053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:03.369467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3185e04d-9ca5-4139-8af1-155844627c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.225298 Aug 31 12:37:03.370523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 998/1976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:03.379426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:03.380521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:03.384656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=68 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:03.391873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.392365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.392779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.393508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.393952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.394373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.412176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:03.422133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b8ca5629-c327-4c0d-82ce-368fbdb1f3cd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.257089 Aug 31 12:37:03.422727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 979/1977] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:03 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:03.469342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:03.473119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:03.480054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:03.481520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:03.482737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-19e4f41c-19a9-41e3-8c6d-4e6ff46491b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.110827 Aug 31 12:37:03.483360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 999/1978] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:03.953523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:03.954030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:03.961620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.962251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.962758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.963778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:03.964324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:03.964806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:03.994424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:37:04.100237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f98c9dc3-5bba-4303-8665-d955778fe34c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 204 len: 0 microversion: 2.1 time: 0.150145 Aug 31 12:37:04.101228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 980/1979] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:37:03 2022] DELETE /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:37:04.112267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:04.113057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:04.120570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.121206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.121508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.122223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.122678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.123104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.294019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:04.305706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99dd2349-558e-489a-8d04-3b5cfc240683 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.198465 Aug 31 12:37:04.306622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1000/1980] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:04.398533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:04.399944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:04.406663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.407334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.407874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.408877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.409449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.409973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.445470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:04.446873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:04.454944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.455637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.456228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.457131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.457730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.458276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.678167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:04.697260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3c559fb-3953-49f7-879a-bfe5d7a798f0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.303019 Aug 31 12:37:04.698321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 981/1981] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:04.707591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:04.708991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:04.722216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.723583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.724321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.725415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:04.726317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:04.728781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:04.735337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:04.750844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5e91bcb4-3c15-485c-a5da-adef024d7991 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.309157 Aug 31 12:37:04.751887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1001/1982] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:04 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:04.810987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:04.820499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:04.822511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:04.823732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d0e910c-cab3-4c4c-9c57-64070679d97b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123744 Aug 31 12:37:04.824306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 982/1983] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:05.328460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:05.329263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:05.342908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.343475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.343919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.344778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.345236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.345664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.513482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:05.522838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3fde8395-2690-455e-b3af-cf89b5f5dec0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.198426 Aug 31 12:37:05.523411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1002/1984] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:05.732101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:05.733038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:05.740623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.741114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.741551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.742269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.742816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.743266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.781021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:05.782071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:05.792700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.793522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.794272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.795528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.796323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.797064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.929181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:05.939789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c574eccc-6cf5-4cb8-af96-dc915d04bc00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.211555 Aug 31 12:37:05.940642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 983/1985] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:05.949369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:05.950579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:05.962210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.963077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.963901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:05.965235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:05.966070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:05.966553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:06.005683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:06.017083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ebc776b4-7bc6-4c00-bd94-c70f58683c90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.243653 Aug 31 12:37:06.017935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1003/1986] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:05 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:06.052102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:06.062752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:06.064206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:06.065406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3f87e1f-0791-41da-a101-8b5f112fda04 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123502 Aug 31 12:37:06.065968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 984/1987] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:06.555034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:06.555823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:06.564130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:06.564686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:06.565155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:06.565881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:06.566391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:06.566912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:06.724387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:06.733673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b9276727-1ca4-4434-86ee-c47f9c230022 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.183064 Aug 31 12:37:06.734273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1004/1988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:06.977931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:06.979052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:06.990851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:06.991754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:06.993418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:06.994236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:06.995115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:06.995905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.043305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:07.044257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:07.052777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.053571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.054085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.054885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.055599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.056082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.259611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:07.275724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ea70f1be-3e6f-49c8-89f9-5a2345670b7e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.304646 Aug 31 12:37:07.276768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 985/1989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:07.283815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:07.284868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:07.296589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:07.297542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.298226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.298882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.299741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.300382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.301017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.309651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d968578-9023-46f4-af98-33ad18952f9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.270794 Aug 31 12:37:07.310711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1005/1990] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:07 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:07.373398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:07.383226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:07.385046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:07.386263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a10198a7-418f-47ff-9c63-8c0d06b9bc78 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.108171 Aug 31 12:37:07.386810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 986/1991] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:07.755971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:07.756646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:07.764381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.764879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.765321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.766277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:07.766542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:07.767011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:07.948558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:07.964473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fb851f4-dda3-4bd3-a7a7-66ee7bf6ac56 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.212272 Aug 31 12:37:07.965508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1006/1992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:08.304505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:08.305236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:08.313158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.313657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.314091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.314817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.315267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.315737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.339025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:08.339902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:08.347160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.347777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.348214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.348951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.349472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.349902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.547226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:08.559729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-689baabf-9608-4a72-a107-05a8ec513dd0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.259479 Aug 31 12:37:08.560225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:08.560716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 987/1993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:08.569989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:08.571187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:08.574558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-84b3896a-1697-4199-905f-d899701570c7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.239927 Aug 31 12:37:08.575800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1007/1994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:08 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:08.582815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.583897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.584490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.585440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.586083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.586810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.661675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:08.672063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:08.673504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:08.674690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1cecb5a4-8f4e-461d-b6c6-2a35dc20240d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.112694 Aug 31 12:37:08.675362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 988/1995] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:08.987151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:08.987947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:08.995875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.996372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.996806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:08.997522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:08.997969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:08.998388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.185028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:09.194513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8af95eb-71e5-4bda-b453-cc43a9bd57bf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.211220 Aug 31 12:37:09.195112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1008/1996] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:09.595903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:09.596596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:09.606676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:09.607059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.607488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:09.607715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.608074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.608876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.609381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.609968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.615750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.616074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.616417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.617153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.617587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.618011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.855962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:09.861219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:09.870503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65a90b7e-85f8-4738-8122-81feb7c79811 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.269262 Aug 31 12:37:09.879142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1009/1997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:09 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:09.883728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b3cf3a30-8625-40d6-90bf-7c1ffa64c24c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291696 Aug 31 12:37:09.885010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 989/1998] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:09.888477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:09.889515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:09.902056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.903379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.903686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.904937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:09.905760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:09.906446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:09.991893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:10.003591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:10.005374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:10.006766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75a7c076-95b0-4e16-a8e0-a86fb0c27e35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.125703 Aug 31 12:37:10.007450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1010/1999] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:10.218553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:10.219256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:10.226542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.227207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.227687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.228602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.229177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.229743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.385897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:10.395494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-649ba0e2-faab-4304-ad3b-8c2f021830a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.181154 Aug 31 12:37:10.396244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 990/2000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:10.906769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:10.907546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:10.914700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:10.915400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:10.918856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.919755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.920538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.921787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.922572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.923053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.923362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.923586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.924039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.924753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:10.925211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:10.925626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:10.960279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:11.172793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.177868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.186425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff4b51f6-47e9-4235-97aa-77831fbc7487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.275601 Aug 31 12:37:11.187219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 991/2001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:11.189502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76361733-df4c-4b99-afd7-14d6dfdd2a39 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.286934 Aug 31 12:37:11.191412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1011/2002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:10 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:11.192634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:11.193314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:11.201101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:11.201811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:11.202330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:11.203142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:11.203689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:11.204182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:11.278928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.290490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.293788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.295023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8bd192cc-35c4-4749-b8c9-1f085c26292b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.106749 Aug 31 12:37:11.295634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 992/2003] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:11.422641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:11.423643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:11.435052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:11.435939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:11.436715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:11.438003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:11.438809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:11.439603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:11.654613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:11.663863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-081760da-5adb-4b55-b0f1-9e53a5d10931 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.248617 Aug 31 12:37:11.664721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1012/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:12.217503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:12.218544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:12.220296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:12.220908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:12.228501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.229134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.229712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.230613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.230806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.231276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.231466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.231941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.232215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.233461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.234279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.235056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.573734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:12.580002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:12.583464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d08cc47f-8613-4cec-9e0e-dacbb9da8631 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.367326 Aug 31 12:37:12.584074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1013/2005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:12.589309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:12.590012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:12.597416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e9983c42-183c-402e-9d42-0a188f9d3caa tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.384436 Aug 31 12:37:12.598330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.598972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.599912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.600904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.601568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.602360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.607904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 993/2006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:12 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:12.682231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:12.688856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:12.689795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:12.693766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:12.695488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:12.696573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a7e31e86-e746-44c2-aba3-3491e6fef8dd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.111499 Aug 31 12:37:12.697389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1014/2007] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:12.697604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.698453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.699757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:12.701237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:12.702051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:12.702809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.258010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:13.267800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d67e4792-ccfc-4bae-ad54-5a397f0e49f0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.583498 Aug 31 12:37:13.268514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 994/2008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:13.619698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:13.620544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:13.626573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:13.627191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:13.628378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.629044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.629717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.630523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.630996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.631581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.633866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.634372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.634808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.635573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.636033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.636501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.862045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:13.867672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:13.878028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d918c181-8705-466f-b2ee-6f689d49b23d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.262450 Aug 31 12:37:13.879814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1015/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:13.883082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d71066d-26c1-4bf0-b0b6-fb2137c87c29 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.260578 Aug 31 12:37:13.884554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 995/2010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:13 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:13.888739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:13.890283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:13.904499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.905356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.906114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.907521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:13.908507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:13.909258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:13.938453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:13.989969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:14.000359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:14.002617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:14.004121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ac9e9af9-0a1b-4839-a889-bbef2eac2474 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.122470 Aug 31 12:37:14.004870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1016/2011] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:14.290300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:14.291088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:14.299711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:14.300228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:14.301174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:14.301900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:14.302569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:14.303122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:14.524680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:14.534725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b6343773-ade8-4855-8b35-9f4dce16e57e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.248360 Aug 31 12:37:14.535488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 996/2012] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:14.904567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:14.905239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:14.912679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:14.913163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:14.913597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:14.914309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:14.915111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:14.915832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:14.916424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:14.917440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:14.928062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:14.928653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:14.929173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:14.930003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:14.930468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:14.930898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.251994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.261203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0e88b3f6-0f84-4148-8590-738b861d1df0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.361170 Aug 31 12:37:15.261962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1017/2013] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:15.267467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:15.268067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:15.271187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.275570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:15.276083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:15.276518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.277240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:15.277693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:15.279250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.290401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db4d2d50-29bd-4983-a3e1-ec14467ae783 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.380199 Aug 31 12:37:15.291708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 997/2014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:14 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:15.354983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.364611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.366067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.367287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d6f366d-5660-4c42-887a-cadac48420d4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.103933 Aug 31 12:37:15.367865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1018/2015] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:15.557230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:15.557883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:15.566068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:15.566563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:15.566975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.567791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:15.568236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:15.568637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:15.735859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:15.753579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a41ed7b7-a919-4271-b9f2-7d8c31970150 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.199722 Aug 31 12:37:15.754604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 998/2016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:16.288380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:16.289056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:16.296666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.297183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.297620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.298348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.298802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.299221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.315105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:16.316295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:16.324331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.325004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.325677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.326801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.327400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.328295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.562618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.576816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6cae572e-e814-4a8c-9166-049e882f7238 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291938 Aug 31 12:37:16.577910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1019/2017] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:16.586476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:16.587556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:16.594743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.596025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.596719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.597197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.597967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.598467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.599211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.612115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ea45bb0e-95fe-4c4a-860d-f82da3dcca9f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.301039 Aug 31 12:37:16.613867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 999/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:16 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:16.703439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.713539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.715044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.716396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5f6279a6-f086-4f13-8277-922824a7b042 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.137013 Aug 31 12:37:16.717734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1020/2019] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:16.790386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:16.791134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:16.798184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.798703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.799134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.799884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:16.800330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:16.800723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:16.961968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:16.972635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d87ca1e5-dc97-41ed-aee3-c8c9c9957737 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.186199 Aug 31 12:37:16.973334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1000/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:17.598853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:17.599596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:17.607641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.608839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.609288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.610330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.610800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.611294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.653324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:17.655452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:17.668010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.668508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.668948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.669731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.670361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.670788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.876002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:17.886730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f4aa8674-2941-40aa-a989-8421697cbaf3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.292146 Aug 31 12:37:17.887595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1021/2021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:17.893053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:17.894084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:17.902732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.903533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.904242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.905304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:17.906447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:17.907167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:17.915719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:17.929814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-99cef744-a870-4a73-ad19-a423c48a8bfc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.284401 Aug 31 12:37:17.930920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1001/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:17 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:17.984849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:17.994513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:17.995203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:17.995997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:17.998056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:17.999960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a4bff9b-956b-40e3-abec-3b6a4140ac31 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.111356 Aug 31 12:37:18.000689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1022/2023] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:18.005352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.006255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.007036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.008396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.009235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.009989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.186851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:18.196650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a669aca0-586f-4813-96eb-65a6c0c15846 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.206097 Aug 31 12:37:18.197267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1002/2024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:18.923804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:18.924722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:18.933278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.933953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.934466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.935220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.935707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.936134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.959537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:18.960624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:18.973816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.974642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.975340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:18.976393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:18.977202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:18.977924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:19.162511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:19.176662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82a6a87d-b223-4d8d-a9fe-5a5bb2638ffa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.257124 Aug 31 12:37:19.177718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1023/2025] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:19.198146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:19.199396 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:19.204648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:19.211175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:19.212168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:19.213024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:19.214407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:19.215352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:19.216203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:19.216705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-32f1af9b-41a5-438f-bd11-383cb2bf819b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.264904 Aug 31 12:37:19.217641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1003/2026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:18 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:19.232872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:19.234381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:19.243804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:19.244510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:19.244855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:19.245670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:19.246144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:19.246527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:19.325203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:19.342421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:19.345682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:19.348015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2af306a-62a7-49d5-a77c-25bb67b2fc35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.162887 Aug 31 12:37:19.363540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1024/2027] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:19.439957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:19.449342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8afa4488-fb67-449f-8813-a5ef50d71c8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.224501 Aug 31 12:37:19.449981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1004/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:20.205656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:20.206667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:20.217834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.219041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.219849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.221091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.221905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.222675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.253912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:20.254966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:20.262703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.263397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.264040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.264868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.265644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.266221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.571944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.581144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d01c213d-170b-4dfa-bc36-308e32253e6d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.382889 Aug 31 12:37:20.582879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1025/2029] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:20.585466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.587790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:20.588408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:20.596785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.597282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.597582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0b9c334-8ad4-4b23-aa8f-6cd63d117fd4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.351979 Aug 31 12:37:20.597862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.598379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1005/2030] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:20 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:20.602668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.603416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.604043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.605750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:20.606715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:20.615926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.616662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.617277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.618170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:20.618642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:20.619071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:20.686771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.695300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.696923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.698174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a2e97d0c-bf54-4a7b-84cd-b8c94337c682 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.114251 Aug 31 12:37:20.698766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1026/2031] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:20.817237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:20.828307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-101c4d3a-6754-4520-afab-94d498250ad3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.228570 Aug 31 12:37:20.828903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1006/2032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:21.602919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:21.603856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:21.611295 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.611812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.612235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.614625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.614625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.614625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.623847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:21.624953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:21.636532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.637106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.637657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.638802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.639538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.640327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.872994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:21.882832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:21.890304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd067806-4b7d-4e8a-bfd7-b74f036fd28e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291180 Aug 31 12:37:21.894544 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1027/2033] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:21.894906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9443c382-80ec-487e-8627-85c9e8f652bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.277736 Aug 31 12:37:21.895778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1007/2034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:21 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:21.900760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:21.901472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:21.904138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:21.905684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:21.909989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.910573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.911086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.912318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.912513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.913031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.920939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.922252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.923408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.924560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:21.925108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:21.925614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:21.935950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:22.033291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:22.045765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:22.047797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:22.049230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2856cf7f-2e5f-4142-871a-bd54d66ab2f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.155962 Aug 31 12:37:22.049820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1028/2035] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:22.117385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:22.132863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-00e26cd1-4ea7-403a-a58e-513e0fe3d65d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.236052 Aug 31 12:37:22.133776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1008/2036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:22.931412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:22.932080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:22.940254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:22.941108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:22.941108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:22.941474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:22.941637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:22.941911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:22.942367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:22.942791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:22.949097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:22.949594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:22.950033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:22.950763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:22.951216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:22.951676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:23.190883 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:23.201600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3acf22e3-40e3-4a37-9e50-3dd0f8149657 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.265857 Aug 31 12:37:23.201907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:23.202371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1009/2037] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:22 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:23.207999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:23.208722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:23.215637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:23.216214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:23.216773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:23.217229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f40f9e3b-a801-4e43-b9f3-612a152c4a58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.289582 Aug 31 12:37:23.217616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:23.218144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:23.218653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1029/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:23.224155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:23.228992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:23.230138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:23.241716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:23.242559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:23.243335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:23.244610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:23.245894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:23.246124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:23.298892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:23.308909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:23.310598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:23.311867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11e3634a-b072-4615-8d5b-27bce38a57ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.108254 Aug 31 12:37:23.312450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1010/2039] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:23.461603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:23.477595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ce2067f8-4c21-4708-b6eb-4ed8b1dbc362 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.257055 Aug 31 12:37:23.478489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1030/2040] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:24.233411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:24.234547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:24.241920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:24.242773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:24.243219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.243808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.244241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.244965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.245639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.246111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.252000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.253143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.253730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.254520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.255165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.255998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.486871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:24.499401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf9c1e65-0b52-4dc4-b1ae-58091717c5a6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.262456 Aug 31 12:37:24.500319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1031/2041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:24.508104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:24.509105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:24.509610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:24.519965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.520722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.521749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.522963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.523757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.524465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.526069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fa5feff1-ab6c-473e-9c6e-2eaad8488563 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.297188 Aug 31 12:37:24.527049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1011/2042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:24 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:24.536185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:24.537206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:24.547767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.548560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.550431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.552273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:24.553352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:24.554065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:24.633384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:24.645068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:24.646833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:24.648532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f554a87-09cc-4d9b-94a0-5d6129c847c6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.146845 Aug 31 12:37:24.649345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1032/2043] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:24.757507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:24.769385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a74bac94-1d0b-430f-8a60-d1e6c8bea149 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.240286 Aug 31 12:37:24.770093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1012/2044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:25.533282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:25.534112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:25.541528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.542015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.542450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.543154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.543775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.544219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.549083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:25.553026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:25.553949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:25.562042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.562617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.563095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.564056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.564526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.565046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.790827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:25.802155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:25.805759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4bf87a24-aa2d-41d7-b4a8-a2c53871f726 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.276762 Aug 31 12:37:25.806744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1033/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:25.814619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:25.816091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:25.817667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd68f960-8def-4ca9-95e1-acb5ba8a597a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.268793 Aug 31 12:37:25.828017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.828355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1013/2046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:25 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:25.828904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.829797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.831000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.832087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.832853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.833891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:25.834584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:25.843560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.843560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.844089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.844567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:25.845090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:25.845671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:25.927844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:25.939543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:25.941174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:25.942388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e3ff7fd9-fe87-49ba-acee-2d23240d0699 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.134254 Aug 31 12:37:25.942954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1034/2047] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:26.040945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:26.051266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a767c9cf-f63f-4aa8-90f4-d07d5ec5d0d9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.220829 Aug 31 12:37:26.051969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1014/2048] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:26.836659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:26.837686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:26.845709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.846388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.846888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.848405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.848929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.849532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.858695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:26.859878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:26.871773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.872611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.873371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:26.874654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:26.875624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:26.876298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:27.081666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:27.091365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b40be8e1-a8ce-4cae-8149-7edd47afd6e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.259416 Aug 31 12:37:27.091882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1035/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:27.096681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:27.097351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:27.103844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:27.104327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:27.104977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:27.105936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:27.106742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:27.107164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:27.114337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:27.124537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4556d5bc-7fdd-4d97-a164-8c25274077b7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.273012 Aug 31 12:37:27.125152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1015/2050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:26 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:27.130654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:27.131291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:27.139284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:27.140149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:27.140594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:27.141371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:27.141835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:27.142263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:27.190851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:27.201531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:27.203216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:27.204804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-764d109a-b2fb-4579-8d90-3e525754f863 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.111938 Aug 31 12:37:27.205673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1036/2051] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:27.328189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:27.341038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3a3b74a1-d7f0-40e5-8d3f-99b4ddae631f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.214644 Aug 31 12:37:27.341705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1016/2052] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:28.128381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:28.129019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:28.136674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.137230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.137595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.138328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.138829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.139300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.149287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:28.149903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:28.162220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.163127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.163884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.165130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.165936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.166687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.369530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.379187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-df466bc0-dbca-4bfe-beb2-930c7d72b996 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.254877 Aug 31 12:37:28.379865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1037/2053] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:28.384883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:28.385500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:28.392421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.392908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.393341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.394069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.395076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.395076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.406010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.417410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e21dd500-45f9-496e-b3ba-2385a670b3ab tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.273332 Aug 31 12:37:28.421065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1017/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:28 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:28.424133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:28.424796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:28.434411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.435305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.436283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.437509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:28.438184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:28.438690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:28.493624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.503204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.505522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.506808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5fcf9e26-86bb-426a-8534-263db799a8a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.125967 Aug 31 12:37:28.507610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1038/2055] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:28.640478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:28.650541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae97ea71-026f-4497-ad20-27352de38e3d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.230969 Aug 31 12:37:28.651139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1018/2056] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:29.407039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:29.407748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:29.416133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.416628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.417075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.417782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.418226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.418642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.443795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:29.444707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:29.452339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.452829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.453271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.453979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.454435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.454859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.654882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.670435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5946eb17-0a01-43b8-8fef-da63a08b3506 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.266692 Aug 31 12:37:29.671607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1039/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:29.677770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:29.678515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:29.683697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.685922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.686411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.687421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.688175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.688632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.689065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.697651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fadbe3f9-7b3e-4a1e-8855-9ed6e0b2a613 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.257858 Aug 31 12:37:29.698680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1019/2058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:29 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:29.707135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:29.708480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:29.718786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.719643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.720615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.721813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:29.722373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:29.723093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:29.781219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.792658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.795729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.797281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7608b76c-fcd8-4f9f-892b-29210597a06d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124781 Aug 31 12:37:29.798025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1040/2059] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:29.899360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:29.908685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78ce7ba0-bd5e-4905-81df-44cabbb01f5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.208246 Aug 31 12:37:29.909284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1020/2060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:30.695707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:30.696417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:30.703596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.704197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.704637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:30.705354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.706144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.706898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:30.726739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:30.728374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:30.740055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.740918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.741684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:30.742936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.743828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.744593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:30.975541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:30.984835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40028fad-31d7-4941-8743-bee963c76da0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.293472 Aug 31 12:37:30.985423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1041/2061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:30.990775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:30.991457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:30.998271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:30.998950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:30.999473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.000283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.000752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.001167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.022224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:31.032391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04b67ad7-00fd-40d7-b8ee-d6bfeac98f20 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.313324 Aug 31 12:37:31.033311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1021/2062] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:30 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:31.042706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:31.044389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:31.057397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.058262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.058796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.059641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:31.060094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:31.060946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:31.083663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:31.100199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:31.102656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:31.104453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-212a6233-0ba9-4911-aca1-2470a1202e16 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.117863 Aug 31 12:37:31.105278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1042/2063] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:31.224241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:31.235825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-305accc8-bf05-44b7-8497-c6fdd4e2489c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.200060 Aug 31 12:37:31.236808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1022/2064] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:32.012772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.013713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.021016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.021622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.022251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.023191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.023760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.024466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.067092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.067966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.075610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.076091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.076682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.078104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.078104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.078978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.311604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.329802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-42396a48-990d-4dbc-9c36-0d6662c8ab6f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.320860 Aug 31 12:37:32.330845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1043/2065] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:32.332860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.338728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.340669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.349275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.350280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4873f7a-d649-4732-b19a-fb092ad80291 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.286798 Aug 31 12:37:32.350521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.351386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1023/2066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:32 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:32.351771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.353217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.354212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.355055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.367712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:32.368751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:32.386328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.386816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.387935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.388199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:32.388772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:32.389508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:32.474956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.486860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.488385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.489618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cba03d01-f882-4653-a236-a57dfe73c1b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.157320 Aug 31 12:37:32.490195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1044/2067] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:32.602279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:32.606376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:32.612444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11009dea-619c-4d06-9a63-3fd35bdea4b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.250430 Aug 31 12:37:32.613209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1024/2068] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:33.363145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:33.363941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:33.371342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.372223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.372659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.373508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.373976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.374455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.380489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:33.381587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:33.385357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:33.394914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.395760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.396495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.397765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.398689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.399409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.654440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:33.662154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:33.669155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ece27b30-41d5-480b-beb5-e0927b326d8b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.310202 Aug 31 12:37:33.670056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1045/2069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:33.678922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:33.679324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-932ba1d1-38ea-4f15-842e-602829eedf25 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.303961 Aug 31 12:37:33.691288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:33.691624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1025/2070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:33 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:33.691624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:33.691624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:33.692379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=94 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:33.694877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.695092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.695476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.695773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.695956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.701661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.701942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.701942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.701942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.702232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:33.702232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:33.702232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:33.823075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:33.837619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:33.839160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:33.840480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b2f321dc-d835-414e-aede-38bc1bc7f3a0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.169050 Aug 31 12:37:33.841098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1046/2071] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:33.922224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:33.938096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22495424-a077-4d63-b8ec-fc097c79e449 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.256398 Aug 31 12:37:33.939332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1026/2072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:34.712308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:34.713258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:34.721208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:34.722552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:34.724297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:34.724967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:34.725767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:34.727486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:34.727890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:34.728412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:34.734265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:34.734881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:34.735365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:34.736124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:34.736663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:34.737278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:34.987013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:34.993170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:34.998693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-219065d6-12f0-41db-ad60-4cda450ed37f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.282537 Aug 31 12:37:34.999400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1027/2073] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:35.005445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-555c70a0-1f50-4e70-9c93-40d15b639b69 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.298748 Aug 31 12:37:35.006820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1047/2074] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:35.008556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:35.009708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:35.017413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:35.018507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:35.021183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.022384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.022860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.024262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.025094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.026138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.028889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.029514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.030121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.030980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:35.031572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:35.033530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:35.117335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:35.129189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:35.130988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:35.133046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-56e88739-0106-481f-b15e-eded8971a905 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.131725 Aug 31 12:37:35.134261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1028/2075] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:35.272095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:35.282100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4880b59d-f1b9-4109-a437-0c2e9c94d571 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.269268 Aug 31 12:37:35.282697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1048/2076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:36.035116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:36.036076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:36.043936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:36.044756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.044756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.045184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.045925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.046102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:36.046383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.046818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.056513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.057164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.057765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.058720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.059368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.059924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.233906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.247956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-564998e2-5c12-433d-813e-0e5ae9ff418c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.216643 Aug 31 12:37:36.248997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1029/2077] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:36 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:36.259628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:36.259628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:36.267933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.268735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.269468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.270706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.271520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.272213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.384279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.394940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.396969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.400036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fd52d944-c5cc-480b-8ded-dd14d5be5f6f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.148442 Aug 31 12:37:36.401007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1030/2078] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:36.408537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:36.409160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:36.421165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.421165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.423477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.423477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:36.423932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:36.424814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:36.490092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.495151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:36.501816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-394fdeda-6c06-4389-af89-520abede4a25 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.463156 Aug 31 12:37:36.502409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1049/2079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:36.589860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:36.598978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f5d9db81-3126-43e0-9288-961ebfa9cda6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.196586 Aug 31 12:37:36.599787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1031/2080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:37.276054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:37.276717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:37.284275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.284770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.285246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.285997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.286469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.286938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.445965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:37.447003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:37.454873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.455389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.456198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.457027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.457611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.458110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.479267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:37.490021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d11495fa-c4d7-4eb2-b9dd-3edfc406dfd6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.218950 Aug 31 12:37:37.490958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1050/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:37 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:37.527757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:37.528339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:37.536140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.536656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.537477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.538422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.539281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.539828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.551002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:37.561306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:37.562798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:37.564066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9ed32f9f-9dd4-4a22-b840-1426c3ee7c2a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.122604 Aug 31 12:37:37.565001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1032/2082] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:37:37.625791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:37.626907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:37.638643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.639544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.640316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.641576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:37.642307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:37.642911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:37.813819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:37.825022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b4e03ddf-8202-4f1d-9187-7e65bf20d9ff tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.302121 Aug 31 12:37:37.825830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1051/2083] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:37.870972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:37.884916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-217c22ea-668c-4bb7-9834-62a5cfc7cdbb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.266141 Aug 31 12:37:37.885796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1033/2084] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:38.513752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:38.514402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:38.521879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.522371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.522804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.523773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.524458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.524947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.589048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:38.590079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:38.600442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.601207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.601755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.602757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.603641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.603975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.702079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:38.714755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:38.716614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:38.718585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-077fdb15-e070-49c7-bf64-ea2aeded9896 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.133726 Aug 31 12:37:38.719621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1034/2085] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:37:38.720972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:38.732112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5fff2c82-8ddf-432a-a82d-f2061c32ccba tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.222670 Aug 31 12:37:38.733718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1052/2086] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:38.851686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:38.852796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:38.863084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.863926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.864574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.865714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.866188 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.866619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.914538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:38.915376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:38.922538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.923177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.923764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:38.925195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:38.925437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:38.925903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:39.103182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:39.113964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-59e33f99-a78f-453e-90c2-e255d788247e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.269389 Aug 31 12:37:39.114828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1035/2087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:39.145481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:39.154743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a783e2fc-28fc-4e6c-9ebf-1c9015a37cbc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.245480 Aug 31 12:37:39.155522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1053/2088] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:39.748844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:39.749997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:39.758498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:39.759223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:39.763480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:39.764324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:39.765094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:39.766315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:39.767132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:39.767921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:39.768128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:39.768423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:39.768834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:39.769565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:39.770007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:39.770448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:39.908704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:39.920387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:39.921814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:39.923053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-600e79e1-1ce4-488f-b5e8-7c18bf16aab0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.181954 Aug 31 12:37:39.923688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1036/2089] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:39.985341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:39.996720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-287bab6c-170a-4559-a272-578be2b603c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.242725 Aug 31 12:37:39.997512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1054/2090] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:39 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:40.140050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:40.140937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:40.148290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:40.148927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:40.149559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:40.150365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:40.151067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:40.151643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:40.181068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:40.182150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:40.190543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:40.191011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:40.191512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:40.192614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:40.193291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:40.193957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:40.753882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:40.767949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc06cdb7-060d-4e46-ab2a-0dbce4a55b67 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.633149 Aug 31 12:37:40.768558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1037/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:40.784376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:40.797109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b241086a-1f5b-4ab8-860f-72b310ea6b7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.620914 Aug 31 12:37:40.797702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1055/2092] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:40.950829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:40.951914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:40.964893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:40.965487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:40.965978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:40.966800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:40.967509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:40.968273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.022656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:41.023641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:41.033207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.034083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.034854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.035893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.036383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.036811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.066097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:41.079422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:41.082411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:41.084597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db3b3d9e-04e8-4b90-9c09-fede233b2ee1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.139878 Aug 31 12:37:41.085639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1038/2093] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:37:41.235425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:41.253631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-203caac0-2844-4f48-b776-5b18c4ea5523 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.235707 Aug 31 12:37:41.254648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1056/2094] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:41 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:41.790741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:41.791671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:41.799637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.800266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.800696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.801595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.802201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.802682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.833393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:41.834271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:41.844670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.845160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.845589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:41.846303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:41.846751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:41.847169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:42.151090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.163158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a84f4ef7-c5c3-42c2-a34c-454993f07331 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.376525 Aug 31 12:37:42.166634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1039/2095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:42.173651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:42.174778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:42.180539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.186681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:42.187446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:42.188292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:42.189595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:42.190328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:42.191073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:42.196813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-93cadb11-2a2f-4651-adc4-b777d9ed2269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.373933 Aug 31 12:37:42.197798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1057/2096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:42.276055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.288601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:42.289405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:42.295469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.296236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:42.296733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:42.297160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:42.297888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:42.298326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.298750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:42.299179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:42.300514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cfada9ff-6f6e-43ef-8bdb-f250ceb8c988 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.134744 Aug 31 12:37:42.301526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1040/2097] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:42.463019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:42.473113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f197fff-1632-457c-bb19-582b0f9a0956 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.189262 Aug 31 12:37:42.473726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1058/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:42 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:43.192081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:43.192798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:43.200851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.201333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.201770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.202584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.203084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.203593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.225761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:43.233684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:43.234602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:43.243266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.244072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.244671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.245804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.247271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.247800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.452256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.466394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-722de6fc-b1ef-42be-bbdc-879e1ec021e5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.277882 Aug 31 12:37:43.467482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1041/2099] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:43.476529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:43.477658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:43.488195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.489038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.489173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.490065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.491892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.493059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.493809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.501011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-248f6969-76b6-4f7e-a30f-40e13ec732f9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.273075 Aug 31 12:37:43.501856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1059/2100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:43.509415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:43.510504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:43.524738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.525523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.526135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.526932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:43.527539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:43.528020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:43.603463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.614088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.616063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.617614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-624b94e6-890a-4a6e-9c2d-712498e4f96d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.148512 Aug 31 12:37:43.618478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1042/2101] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:43.758233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:43.771762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-929c867e-badf-437c-b5d5-cdeb8d1cde0c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.268077 Aug 31 12:37:43.772338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1060/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:43 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:44.501889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:44.502801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:44.512632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.513413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.514181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.515542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.516363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.517124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.531146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:44.532496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:44.542328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.542963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.543548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.544293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.544757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.545183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.848001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:44.859095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:44.859492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c74687bc-4c56-48eb-929d-2012bb956723 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.361468 Aug 31 12:37:44.860399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1043/2103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:44.864942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:44.865548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:44.875601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e0c0e81-3fcb-4095-ae8b-c0cc87db4d1a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.350818 Aug 31 12:37:44.880041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1061/2104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:44.880328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.880328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.880328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.880328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.880982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.880982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.885676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:44.886786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:44.897954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.898805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.899616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.900865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:44.901657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:44.902420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:44.977863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:44.995103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:44.997999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:45.000248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-36b5394e-c971-49ff-8cfd-4c6fdb899d9f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.138853 Aug 31 12:37:45.001291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1044/2105] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:45.103585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:45.118017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b0cf5c5-ae54-405c-9073-7b6a89345fd2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.239119 Aug 31 12:37:45.119041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1062/2106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:44 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:45.887856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:45.888841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:45.896909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:45.897402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:45.898063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:45.899019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:45.899495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:45.900104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:45.913110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:45.914229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:45.929284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:45.929284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:45.930113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:45.930784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:45.931353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:45.932091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.387518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.396329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.401211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-097aeced-ab78-4069-a3c5-5ca3a5c66841 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.517334 Aug 31 12:37:46.402043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1045/2107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:46.407490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:46.408234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:46.415555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d89fbb02-a4ee-43a9-a5a0-ebe0b20f20ad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.508260 Aug 31 12:37:46.415819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:46.416041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:46.416477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.417488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:46.417903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1063/2108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:46.418123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:46.418435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.432105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:46.433250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:46.445290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:46.446104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:46.446877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.447861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:46.448304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:46.448928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:46.544582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.562395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.565444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.567504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-64f989ea-d9aa-41fa-aedb-69827e60865e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.164166 Aug 31 12:37:46.579488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1046/2109] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:46.805400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:46.818355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-128695c5-6d9d-4d8a-aa4f-1e1d0cd04964 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.396873 Aug 31 12:37:46.818993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1064/2110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:46 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:47.446068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:47.446867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:47.449675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:47.450542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:47.456112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.456624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.457059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.457798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.458256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.458684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.460905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.461695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.462307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.462994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.463529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.464028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.693178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:47.709186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-622efb83-8dd0-42d1-bf76-5d9a8434771d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.268066 Aug 31 12:37:47.710134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1047/2111] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:47.716399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:47.716818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:47.717474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:47.727368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.728268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.728942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.730054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.730784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.731841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.736160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e8c6bc7b-55e3-460b-87a3-1480eebb9fa1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.290931 Aug 31 12:37:47.737245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1065/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:47.804966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:47.815091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:47.816662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:47.817882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-51d361db-a12a-4c50-846f-cbcddcc6ecf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.106091 Aug 31 12:37:47.818556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1048/2113] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:47.846267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:47.847610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:47.859816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.860640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.861413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.862642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:47.863479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:47.864230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:47.901614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:48.064570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:48.086798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65019188-824c-480f-b4cb-18c1d61f1856 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.248565 Aug 31 12:37:48.087830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1066/2114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:47 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:48.740558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:48.741229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:48.749230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:48.749808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:48.750299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:48.751109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:48.751887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:48.752596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:48.761304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:48.762033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:48.773262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:48.774313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:48.775050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:48.776447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:48.777243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:48.778100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.076414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.092359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f8df7712-efed-4a29-b4d0-aabd15d413ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.355328 Aug 31 12:37:49.093607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1049/2115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:49.102702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:49.103885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:49.117259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.118632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.119254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.119803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.120794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.121566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.122106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.134236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf6545a3-73e2-4469-988b-6049e83ba95d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.378582 Aug 31 12:37:49.135224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1067/2116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:49.144035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:49.145138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:49.156717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.157561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.158623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.159981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:49.160815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:49.161576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:49.214565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.225778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.227288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.228586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f6c5c5b0-d578-4ecb-92d7-a3ae05d35409 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.133782 Aug 31 12:37:49.229178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1050/2117] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:49.363943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:49.373986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a42d6968-1fb7-4e2e-91e4-df2f8a8b7209 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.236345 Aug 31 12:37:49.374620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1068/2118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:49 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:50.125451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:50.126723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:50.136664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.137514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.138210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.139083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.139906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.140796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.161370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:50.162638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:50.170937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.171933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.172591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.173507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.174128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.174715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.500263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.511211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77001b37-da10-40ea-8c53-30270575de07 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.392914 Aug 31 12:37:50.511913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1051/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:50.517615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:50.518232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:50.525025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.525533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.526010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.526670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.527115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.527572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.531556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.544150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03f38b37-e61f-44ff-8f04-32bdbd5d1497 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.386082 Aug 31 12:37:50.545055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1069/2120] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:50.553814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:50.555354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:50.567951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.568838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.569615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.574477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:50.574477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:50.574477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:50.631305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.644190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.646025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.647678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-730e7446-9a3e-4203-badd-5508fdf7bce1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.134361 Aug 31 12:37:50.648577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1052/2121] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:50.776674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:50.792849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-370c4e4e-fe10-4d63-92cb-b819d9460143 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.245880 Aug 31 12:37:50.794180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1070/2122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:50 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:51.544754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:51.545552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:51.553827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.554323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.555221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.556128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.556956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.557773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.586187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:51.587680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:51.599826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.600684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.601453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.602707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.603500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.604260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.797908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:51.808751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fd718a7f-d91d-4425-a665-bf202bded082 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.267910 Aug 31 12:37:51.809651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1053/2123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:51 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:51.818299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:51.819658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:51.832195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.833060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.833830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.835094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.835902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.836439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.841476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:51.856373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-06ac8181-5e39-4295-bb56-5d56fc6f4d77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.277760 Aug 31 12:37:51.857401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1071/2124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:51.866032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:51.867265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:51.878801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.879731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.880520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.881941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:51.882692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:51.883483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:51.923472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:51.936857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:51.939396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:51.940939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40c296f0-ee28-49f4-9b5c-eeea52de8217 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.129997 Aug 31 12:37:51.941533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1054/2125] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:52.055894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:52.067172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e1877dfb-4b74-45eb-b261-02f2521fdc75 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.208323 Aug 31 12:37:52.067803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1072/2126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:51 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:52.843975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:52.845338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:52.852424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.852913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.853346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.854052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.854500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.855114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.888768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:52.895659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:52.906506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.907420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.908215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:52.909548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:52.910362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:52.911207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.119940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.139934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-289d4785-f252-40bc-8d6d-18a4479d02ec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.300057 Aug 31 12:37:53.140468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1055/2127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:53.145586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:53.146491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:53.153957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.154758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.155427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.156146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.157075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.157809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.203772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.220881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa18ab27-fdd3-45cb-bea2-dc1c00bd9ac2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.339337 Aug 31 12:37:53.222286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1073/2128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:53.232638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:53.234680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:53.247200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.248113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.248878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.250265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.251257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.252252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.258520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.278007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.280791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.283551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-35f34d6f-15d6-43bd-8105-115270b9266a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.141581 Aug 31 12:37:53.284489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1056/2129] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:53.292106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:53.292893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:53.303993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.304774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.305488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.306662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.307423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.308117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.353102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:37:53.382602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:53.491305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da4ecf8a-7bfe-422d-ba6f-5e34e7738102 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 204 len: 0 microversion: 2.1 time: 0.205153 Aug 31 12:37:53.492232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1057/2130] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:37:53 2022] DELETE /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:37:53.503997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:53.504750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:53.511619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.512109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.512548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.513259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:53.513712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:53.514246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:53.518219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.531527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8c6b32fd-9657-4108-9d7d-5c63e43ed6fe tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.306798 Aug 31 12:37:53.532728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1074/2131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:53 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:53.689032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:53.699137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b5f323e-367b-477d-9254-908cf3e1db72 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1682 microversion: 2.1 time: 0.200270 Aug 31 12:37:53.699773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1058/2132] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:53 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:37:54.186333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:54.187880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:54.196774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.198107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.199160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.200668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.201306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.202078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.250722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:54.252056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:54.264492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.265571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.266464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.267784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.268599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.269338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.547278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.560426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3d2c15cc-4c7c-42d0-a501-734b798e7842 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.382230 Aug 31 12:37:54.561136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1075/2133] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:54.584225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:54.585406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:54.595976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.596539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.597205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.598409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.599057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.599493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.599834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.612666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d5cd8f0-ed5f-4562-af69-9cdc24e47ccc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.368835 Aug 31 12:37:54.613712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1059/2134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:54.621332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:54.622432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:54.638310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.639615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.640610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.642618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.643719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.644959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.833849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.844686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.846251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:54.848435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9e36fdc-a474-4945-a5e5-e399d7e5df3a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.271197 Aug 31 12:37:54.849007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1076/2135] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:54.869022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:54.869649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:54.877183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.877700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.878132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:54.879094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:54.879595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:54.880017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.112697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:55.123045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-543760dc-860d-4261-9d89-ddbd54667f0a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.507921 Aug 31 12:37:55.123682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1060/2136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:54 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:55.164657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:55.175525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-133c395f-cd59-4e94-8e3f-e23cf517b8f6 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1682 microversion: 2.1 time: 0.310724 Aug 31 12:37:55.176797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1077/2137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:54 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:55.585695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:55.586390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:55.593535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.594044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.594485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.595548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.596500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.597127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.658225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:55.659572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:55.677589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.678523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.679216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.680681 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:55.681459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:55.682823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:55.874435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:55.889941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08069064-b643-4bfa-862f-6649724dc8a7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.307829 Aug 31 12:37:55.896791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1061/2138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:55.973265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:55.983630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-009087e3-2c0b-4781-80de-3eacc5616c1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.332818 Aug 31 12:37:55.984777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1078/2139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:55.991397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:55.991904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2c727c85-cd98-48bf-93ef-d0b675722bf1 req-f5357f4b-c51c-4c67-9839-7a610af530d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5bbaea-c876-457f-bbdd-96c967d56add", "name": "network-vif-deleted", "tag": "f81103d9-f1f6-4a58-b7b2-95f293f80dd2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:37:55.992167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:56.003621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.004266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.004779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.005066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2c727c85-cd98-48bf-93ef-d0b675722bf1 req-f5357f4b-c51c-4c67-9839-7a610af530d4 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.005735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2c727c85-cd98-48bf-93ef-d0b675722bf1 req-f5357f4b-c51c-4c67-9839-7a610af530d4 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.006311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.006521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2c727c85-cd98-48bf-93ef-d0b675722bf1 req-f5357f4b-c51c-4c67-9839-7a610af530d4 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.006906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.007976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.020618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2c727c85-cd98-48bf-93ef-d0b675722bf1 req-f5357f4b-c51c-4c67-9839-7a610af530d4 service nova] Creating event network-vif-deleted:f81103d9-f1f6-4a58-b7b2-95f293f80dd2 for instance 6c5bbaea-c876-457f-bbdd-96c967d56add on hv-cinder-85535 Aug 31 12:37:56.026344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2c727c85-cd98-48bf-93ef-d0b675722bf1 req-f5357f4b-c51c-4c67-9839-7a610af530d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127943 Aug 31 12:37:56.027160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1062/2140] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:37:56.086071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:56.097299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:56.099190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:56.100930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d252fd74-af55-4fe8-bbab-04767cfd175a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.114772 Aug 31 12:37:56.101853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1079/2141] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:56.155892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:56.156593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:56.165279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.166158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.166636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.167661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.168246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.168800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.197601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:56.198230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:56.205867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.206457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.206897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.207672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.208137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.208565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.247062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.247788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.248240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.248706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lazy-loading 'fault' on Instance uuid 6c5bbaea-c876-457f-bbdd-96c967d56add {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:37:56.334423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3e5c1776b8470a9b677bac8dfbc9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f3955065954f8f860bada6261223c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:56.346495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1928847d-51f7-4260-8b99-a1e42c15c122 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 200 len: 1332 microversion: 2.1 time: 0.152473 Aug 31 12:37:56.347520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1080/2142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:56 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:56.416011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:56.427695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f39776a6-8e31-4067-b821-fcb6fa422dd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.277250 Aug 31 12:37:56.428443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1063/2143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:56 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:56.920643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:56.921843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:56.929879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.930872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.931258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:56.932094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:56.932759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:56.933126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.011343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:57.013641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:57.027294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.028686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.029544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.031189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.032395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.033309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.184508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.207147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1e8deb2b-ddaa-4996-b59c-39ac625bf88f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291718 Aug 31 12:37:57.208112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1081/2144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:57.225421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:57.226907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:57.237898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.238664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.239517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.240306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.240850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.241413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.249825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.264898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-59ef71f1-560b-4f8b-a5a2-f0c3e24f07b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.261405 Aug 31 12:37:57.265499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1064/2145] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:57.316879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.320535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:37:57.327756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.329518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.330964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-489698a0-c2f0-4019-8359-c921a28f2f56 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113647 Aug 31 12:37:57.331633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1082/2146] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:57.373847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:57.375021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:57.390901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.391826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.393007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.396522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.397354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.398091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.426280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add HTTP/1.1 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:37:57.429465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:37:57.431352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '6c5bbaea-c876-457f-bbdd-96c967d56add'} Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:37:57.432492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:37:57.434480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:37:57.436059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:37:57.436059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a364a65-c4e1-4984-9456-8c5c97958ae1 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 404 len: 111 microversion: 2.1 time: 0.064965 Aug 31 12:37:57.436059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1065/2147] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:57 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:37:57.443532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7d2f638-c643-4e80-87e2-97c64da35e4c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '.version_select at 0x7fe854b21820>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:57.466525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:57.468021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:57.472021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c7d2f638-c643-4e80-87e2-97c64da35e4c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426517055" status: 202 len: 0 microversion: 2.1 time: 0.033111 Aug 31 12:37:57.473234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1083/2148] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 31 12:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426517055 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:37:57.480163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.480909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.481523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.482617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:57.483381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:57.484102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:57.710438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:57.722192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ea63d4e1-f137-4615-a0c5-d75ebac97f5a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.262626 Aug 31 12:37:57.723640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1066/2149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:57 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:58.244612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:58.245727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:58.255597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.256330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.256839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.257894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.258366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.258888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.311376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:58.313554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:58.326316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.327399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.328457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.330002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.331371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.332833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.752902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.762868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6edd8315-1212-4e76-b440-1e63d66b4dc0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.525514 Aug 31 12:37:58.763498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1084/2150] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:58.769322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:58.769960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:58.777409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.778207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.778829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.779916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.780567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.781193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.853300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.868448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8c7498c-b4e8-406c-9326-989bb6d0e788 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.563135 Aug 31 12:37:58.869507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1067/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:58.872128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.886370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.887867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:58.888316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:58.888905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:58.889216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e6044b70-a9a9-441d-bb95-486e9b615a8c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124564 Aug 31 12:37:58.889805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1085/2152] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:37:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:37:58.904086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.904086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.904086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:58.904086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:58.904512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:58.904512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.057153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:37:59.073293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b8347613-c994-412b-a7b1-41791eaf1d91 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.194375 Aug 31 12:37:59.074362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1068/2153] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:58 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:37:59.793505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:59.794492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:59.802892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.803527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.804055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.804931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.805413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.805956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.894142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:37:59.896559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:37:59.904627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.905261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.905789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:37:59.906846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:37:59.907545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:37:59.908155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.104491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.115572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e05521bd-d35d-4368-904d-d737506e3024 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.325989 Aug 31 12:38:00.116291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1086/2154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:00.123523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:00.124142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:00.131332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.131827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.132263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.133000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.133465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.133891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.173990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.183936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3207e4e-4b1e-47b1-86a1-b166250832e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.295554 Aug 31 12:38:00.184722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1069/2155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:37:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:00.189796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:00.190718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:00.198088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.198744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.199437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.200468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:00.201040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:00.201550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:00.230171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.241481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.243794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.245591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-310b656e-5145-499e-8d38-ca8fd7826b39 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.125954 Aug 31 12:38:00.246377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1087/2156] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:00.375603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:00.384568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bbb69dde-7c10-45bf-ab18-049484d045d7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.198696 Aug 31 12:38:00.385172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1070/2157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:00 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:01.138467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:01.139330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:01.146967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.147708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.148229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.149021 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.149502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.149926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.209933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:01.210863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:01.222193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.223051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.224740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.225022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.225572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.226403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.379104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.388675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b0a4c79f-47a8-4ba3-8d46-27de340312d0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.254292 Aug 31 12:38:01.389351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1088/2158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:01.394256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:01.394940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:01.412423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.413459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.414015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.415566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.416073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.416518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.456234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.465910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f64411d-8001-4aa8-9c34-b909002f1773 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.261793 Aug 31 12:38:01.466513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1071/2159] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:01.471671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:01.472302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:01.474562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:01.481452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.482016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.482473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.483457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:01.484056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:01.484630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:01.519584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.530355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.532089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.533442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee0c42a5-6c5c-4114-b3eb-6bc41602a17c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.143113 Aug 31 12:38:01.534231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1089/2160] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:01.662906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:01.672304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c26cb0cf-bf2c-4220-b826-3538ee7f363a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.204666 Aug 31 12:38:01.672903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1072/2161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:01 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:02.426842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.427954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.440008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.440862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.441661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.442892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.443805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.444552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.496806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.497924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.508191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.508736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.509270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.510112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.510579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.511016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.775258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:02.784855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5502b345-6720-4989-a8f2-230620157ed4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.365616 Aug 31 12:38:02.790908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1090/2162] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:02.797864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.799462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.809952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.810653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.811452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.812640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.813326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.813971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.819957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:02.832358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff0d255d-3fae-496d-a843-36b520b9083a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.340243 Aug 31 12:38:02.833365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1073/2163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:02.842099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:02.843537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:02.855741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.856621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.857423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.859694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:02.860266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:02.860773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:02.892757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:02.922168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:02.934637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:02.937433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:02.938854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-735337b6-a696-4c5e-b463-f0c204683fb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.152282 Aug 31 12:38:02.939708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1091/2164] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:03.045997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:03.061432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8a5f1180-9da0-49ed-ae71-73179ad20183 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.226443 Aug 31 12:38:03.062449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1074/2165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:02 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:03.812415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:03.813078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:03.815612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:03.821890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.822380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.822805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:03.823546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.823989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.824414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:03.869131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:03.870012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:03.878492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.879261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.879859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:03.881068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:03.881644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:03.882351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.166688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.177275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ded35fbf-7e8e-47f6-be66-82729892a8a1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.369609 Aug 31 12:38:04.180663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1092/2166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:04.188781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:04.189791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:04.200919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.201671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.202352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.203518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.204293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.205146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.210686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.222514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b99fb326-c240-4496-b0dc-3cdc303e135f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.358079 Aug 31 12:38:04.231582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1075/2167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:04.231582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:04.231582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:04.238328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.239074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.239780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.240685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:04.241488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:04.242201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:04.371294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.383928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.385853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.387602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-50f71a5e-905f-4224-a633-9b3dcdc0af36 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.206660 Aug 31 12:38:04.388271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1093/2168] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:04.501279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:04.516435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-210f9838-550c-45cd-b86e-dc92e9236a08 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.291342 Aug 31 12:38:04.517446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1076/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:04 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:05.217432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:05.218699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:05.231501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.232352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.233096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.234349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.235153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.235924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.263106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:05.264605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:05.276725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.277596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.278367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.279708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.280546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.281302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.576422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.589761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.592087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6d63422b-b25a-4d16-970e-9d16ee2eed55 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.381882 Aug 31 12:38:05.592972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1094/2170] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:05.605031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-813fdb58-8c41-4858-bc2e-8063db9cfdb2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.349037 Aug 31 12:38:05.606783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1077/2171] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:05.614065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:05.615157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:05.615415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:05.616915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:05.624950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.625693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.626391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.627532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.627804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.628238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.628602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.628913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.629342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.630623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:05.631689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:05.632224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:05.794140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.806847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.809085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.810478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09130c49-36b0-4620-afc0-b88d73a52676 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.204633 Aug 31 12:38:05.811785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1095/2172] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:05.920451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:05.936019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a2f2f0ef-6732-461b-9240-9005f6b5528e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.327531 Aug 31 12:38:05.936993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1078/2173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:05 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:06.627729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:06.628853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:06.641788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.642624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.643452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.644684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.645503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.646244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.648830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:06.649944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:06.662472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.663354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.663962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.665173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:06.665974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:06.666672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:06.996250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.005069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.007113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dab52958-e356-48c1-b7e7-40f2e1f63cbb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.386587 Aug 31 12:38:07.008067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1096/2174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:07.014381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:07.015181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:07.021859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9ec2a0ef-961c-40a8-ae8f-cea2eaa57256 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.380414 Aug 31 12:38:07.023153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1079/2175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:07.030256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.031373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:07.031579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.032256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.032526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:07.033924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.035141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.035853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.043499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.044340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.045108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.046366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:07.047255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:07.048033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:07.176261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.193273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.196596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.198779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-98a6c0d4-9229-4368-ab30-af19f0570bc6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.189132 Aug 31 12:38:07.199838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1097/2176] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:07.260267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:07.274980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-465b4e03-0b3e-4e3f-9dcb-c9e359789653 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.250324 Aug 31 12:38:07.275906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1080/2177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:07 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:08.039107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.040048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.047104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.047621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.048051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.048762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.049208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.049627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.055955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.057107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.069481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.070351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.071438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.072876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.073697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.074458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.403207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.419262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-87f4aa16-ec4e-48a9-8a3a-9941bb3bdae8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.383811 Aug 31 12:38:08.420334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1098/2178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:08.429492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.430458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.430677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.442247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.443121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.443984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.445320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.446300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.446762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.451981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7bf9947c-2ddc-4997-bffe-b794268d8beb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.403239 Aug 31 12:38:08.453128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1081/2179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:08.461629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:08.462724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:08.474056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.474923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.475797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.477105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:08.477958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:08.478940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:08.566212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.581512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.584101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.587292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f5d16a7-7ec2-4362-9bf0-2fe9e8d67c57 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.165251 Aug 31 12:38:08.588217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1099/2180] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:08.734442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:08.750539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e1a5c930-cc53-4562-a571-9a1a3da16c8a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.295670 Aug 31 12:38:08.751635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1082/2181] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:08 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:09.457675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.458669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.469966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.470737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.471444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.472571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.473262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.473942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.489329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.490357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.502398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.503275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.504063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.505234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.505967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.506701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.509733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:09.838698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:09.855398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58fac711-29a1-4e08-a92d-302796aeae43 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.403874 Aug 31 12:38:09.856445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1100/2182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:09.863829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:09.865151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.866258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.877567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.878428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.879200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.880499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.881296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.882034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.883349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3e5ff757-27bb-4002-b6cb-d5402e99e175 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.400346 Aug 31 12:38:09.884562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1083/2183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:09.893536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:09.894529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:09.906686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.908624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.909734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:09.910470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:09.911385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:09.998950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.014634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.017367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.019385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd690175-2efa-4ad1-97de-0e885c253971 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.161356 Aug 31 12:38:10.020316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1101/2184] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:10.131271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:10.147681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1cc9149c-275d-4827-be39-c4818c57f759 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.261490 Aug 31 12:38:10.148530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1084/2185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:09 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:10.889621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:10.890558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:10.901894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.902737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.903523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.904742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.905523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.906296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.919203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:10.920163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:10.931205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.931972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.932703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:10.933864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:10.934601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:10.935279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.264098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.282791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1030ee36-3d21-4a69-b572-752897d705d7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.399663 Aug 31 12:38:11.283790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1102/2186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:11.292284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.293222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.302094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.303753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.304674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.305407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.306996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.307738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.308477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.319655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26f39b9d-2be6-47e6-9f44-23b2ed8fc067 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.406543 Aug 31 12:38:11.320929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1085/2187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:11.329516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:11.330854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:11.343040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.344928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.345792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.347102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:11.347973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:11.348703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:11.432846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.449183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.451823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.453677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d7077898-5abd-406d-95ed-df33aa037f28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.168240 Aug 31 12:38:11.454543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1103/2188] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:11.598058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:11.613861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc4bcf63-b1bc-4f8a-8ff2-60897b165675 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.291101 Aug 31 12:38:11.614914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1086/2189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:11 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:12.318113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:12.319284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:12.333351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.334200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.334956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.336242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.337265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.337983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.355894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:12.356807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:12.368625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.369835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.370720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.372623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.373425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.374112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.673211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.690413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03efe906-4157-4756-9391-337d7ea32186 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.379403 Aug 31 12:38:12.691481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1104/2190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:12 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:12.691709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.700755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:12.702192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:12.706561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4806e182-72ec-41f1-8400-087567178e1b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.357888 Aug 31 12:38:12.716885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1087/2191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:12.717231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.717231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.717231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.717231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.717852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.718005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:12.718160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.718315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:12.729530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.730240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.730905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.732055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:12.732764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:12.733429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:12.840894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.857144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.859715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:12.862078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66d587ca-92e9-48a6-a89f-41948cc11629 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.167819 Aug 31 12:38:12.863034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1105/2192] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:12.991189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:13.005946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d82319ae-f4bf-43ba-8644-04d6a4ef18a9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.296229 Aug 31 12:38:13.006832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1088/2193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:12 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:13.725356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:13.726279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:13.734565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.735398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.736118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.737292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.738403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.739115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.745256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:13.746317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:13.754555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.755049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.755518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:13.756240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:13.756700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:13.757332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.019556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.023056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.034085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4e428244-1e8d-4043-a0ab-cb35659f2e68 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.296763 Aug 31 12:38:14.034939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1089/2194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:14.036433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f67a34b-94f2-4070-af1d-e4e403c4eef8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.315102 Aug 31 12:38:14.055539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1106/2195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:14.055894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:14.055894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:14.056195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:14.056195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:14.057545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.058078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.058857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.060505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.061697 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.062479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.062694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.063459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.064223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.065488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:14.066323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:14.067116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:14.179769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.207453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.210605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.212864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-98c5e104-30d4-4ea2-84b8-bd81f135cfe5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.176374 Aug 31 12:38:14.214220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1090/2196] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:14.283473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:14.293515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a47d617-8436-4ec6-87d5-6b346b9f3ef0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.254611 Aug 31 12:38:14.294183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1107/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:14 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:15.077335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:15.078435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:15.079013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:15.079461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:15.090036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.090403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.090803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.091155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.091506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.091991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.092633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.093272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.093458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.094164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.094382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.094924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.101599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:15.466336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.479651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.481838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c091a5f0-dbca-4b86-8290-9d8aecfb2777 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.411601 Aug 31 12:38:15.488477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1091/2198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:15.492307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:15.493357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:15.495995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f8aaad5-2e21-4fdc-8d77-f3d3f3488c5d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.424281 Aug 31 12:38:15.497282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1108/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:15.503408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.504520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.505339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.505558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:15.506571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.507093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:15.507442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.508256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.519119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.520004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.520752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.521995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:15.522823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:15.523606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:15.637032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.649233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.652373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.654684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5e2cd01d-91c2-406f-a2ff-836bd7c4422f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.168809 Aug 31 12:38:15.657525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1092/2200] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:15.759457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:15.769562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4807b4f9-e946-451f-9dd8-b7e2950b489e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.270952 Aug 31 12:38:15.770334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1109/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:15 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:16.544954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:16.546077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:16.547044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:16.548529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:16.556985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.557943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.558610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.559834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.560510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.560723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.561155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.561632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.562418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.563740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.564602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.565351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.938346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:16.945218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:16.952934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4525bfe0-efc8-4285-8ebb-04c69c01f6d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.414653 Aug 31 12:38:16.953973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1093/2202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:16.959625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1d7fc73d-3b85-4521-be4f-0a3e63664908 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.419578 Aug 31 12:38:16.961054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1110/2203] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:16 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:16.961732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:16.962705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:16.972777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:16.974839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:16.976285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.977105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.977850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.979509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.980054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.980798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.989175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.990054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.990826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:16.992143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:16.992955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:16.993720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:17.102053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:17.122073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:17.125280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:17.127635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2a770e53-8a65-4a27-a4db-70cfe9f3d1f8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.171990 Aug 31 12:38:17.128906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1094/2204] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:17.269945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:17.286143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-57cde0f1-2319-48f5-bcfb-fa2abb80ede9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.322707 Aug 31 12:38:17.287135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1111/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:16 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:17.996114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:17.997086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:17.997809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:17.998752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:18.007118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.007688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.007923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.008403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.008629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.009089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.009418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.010045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.010240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.010944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.011612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.011837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.271285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.280851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.282512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae5df1c6-d626-4818-a881-5ea6e49342a3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.293238 Aug 31 12:38:18.283100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1095/2206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:18.290650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:18.291714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:18.295709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b3dd5bb-7add-43fe-9a28-6d93891e8794 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.302970 Aug 31 12:38:18.297769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1112/2207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:18.301798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.302587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.303267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.304713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.305737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.306410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.324617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:18.325597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:18.335693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.336523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.337205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.338372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:18.339156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:18.339868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:18.425042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.446371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.449909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.452996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5150c6da-d97c-4f7b-8018-58b883154380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.168185 Aug 31 12:38:18.454049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1096/2208] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:18.560913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:18.573911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25cfe6c4-d95c-42bb-907c-aa137701ecd9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.255539 Aug 31 12:38:18.574958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1113/2209] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:18 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:19.322289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:19.323198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:19.327788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:19.328873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:19.336322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.337179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.337912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.339203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.340127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.340318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.340886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.341104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.341863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.343127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.343998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.344727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.681507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.694842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.695219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-03315074-be93-4bbd-8661-20e5ad9fd1fd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.380468 Aug 31 12:38:19.695982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1097/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:19.706312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:19.707497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:19.714184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65d75237-b053-484d-b14e-6f0850ad30a1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.392139 Aug 31 12:38:19.715415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1114/2211] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:19.719402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.720264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.721040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.722328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.723177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.723946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.732212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:19.733052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:19.743763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.744540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.745415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.746685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:19.747520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:19.748263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:19.848276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.859536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.861046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:19.862274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bda245e3-81d0-47f7-8482-85462f997af9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.165039 Aug 31 12:38:19.862848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1098/2212] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:19 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:19.993341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:20.002901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cb14b0a9-aab6-4138-b53c-73484d921374 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.277741 Aug 31 12:38:20.003939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1115/2213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:19 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:20.736459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:20.737474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:20.749244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.750099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.750853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.752108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.752912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.753106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:20.753837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.754374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:20.765900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.766750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.767540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:20.768802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:20.769613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:20.770352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.093624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:38:21.093955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a (ip 10.222.0.27) !!! Aug 31 12:38:21.095989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:38:21.096203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a (ip 10.222.0.27) !!! Aug 31 12:38:21.102631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:21.115370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:21.129415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80929776-20e5-4247-85c2-3b3f359c9383 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.399945 Aug 31 12:38:21.130444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1099/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:21.130946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34a6a734-ec7c-457a-ac38-2068723016e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.385016 Aug 31 12:38:21.144875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1116/2215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:21.145187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:21.145187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:21.145548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:21.145548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:21.151020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:21.151962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:21.152747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.154004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:21.154820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:21.155621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.160358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:21.161738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:21.162509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.164056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:21.164906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:21.165577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:21.173710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:21.268369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:38:21.268685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 (ip 10.222.0.27) !!! Aug 31 12:38:21.272620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:38:21.272936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 (ip 10.222.0.27) !!! Aug 31 12:38:21.301999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:21.319433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:21.322376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:21.324666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-beb87edc-790a-40fe-a61f-366f3a4ab7f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.192492 Aug 31 12:38:21.325938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1100/2216] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:21.432144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:21.452287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4281325-1b34-4ed6-94c2-69f0d144ae69 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.318608 Aug 31 12:38:21.453120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1117/2217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:21 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:22.168851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:22.169981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:22.170577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:22.171717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:22.181323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.182424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.183117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.183718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.184276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.184604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.184816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.185353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.185535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.186039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.186289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.186982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.565859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.581678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-16b06723-5e94-44d7-8c2d-c72da2ec00d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.420142 Aug 31 12:38:22.582719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1101/2218] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:22.584766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.593192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:22.594428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:22.599513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-644cf2b8-cf1a-4599-8a7c-a3e6b55f895c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.435846 Aug 31 12:38:22.600663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1118/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:22.609806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.610461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:22.611051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.611397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:22.611869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.613124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.613905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.614610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.621398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.622457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.623120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.626739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:22.627866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:22.628748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:22.749369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.766627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.769771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.771995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d81acb7a-b41c-4dc6-927b-ef65fa8faa28 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.186732 Aug 31 12:38:22.773063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1102/2220] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:22.908513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:22.924722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6bd65048-b88a-4015-89bc-2ddda22bb1b4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.322333 Aug 31 12:38:22.925778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1119/2221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:22 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:23.617007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.617903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.624983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.625473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.625917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.626632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.627087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.627546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.641038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.642189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.654879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.656257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.657076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.658689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.659533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.660305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.931053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:23.946908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a274c6fa-7b8f-4280-8565-5d24af4fdc2c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.333727 Aug 31 12:38:23.947994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1103/2222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:23.961289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:23.966236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.967628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.977345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a92a184-7cd1-49de-a76a-3ea1137dc04b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.343312 Aug 31 12:38:23.978364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1120/2223] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:23.979381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.980271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.981099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.982266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.983028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:23.983723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:23.986369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:23.988397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:23.998256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:23.999447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.000165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.001339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.002071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.002786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.084741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:24.095978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:24.098090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:24.099688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef9b3ab5-e882-40a5-8fda-9cfe394a9fd8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.141198 Aug 31 12:38:24.100584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1104/2224] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:24.238359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:24.255007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4e336e3-5304-4b66-af20-a9957c2f34e1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.274541 Aug 31 12:38:24.256082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1121/2225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:23 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:24.985034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:24.986041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:24.996782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:24.997727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:24.998518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:24.999688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.000399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.001055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.015207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:25.016341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:25.024329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.024949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.025554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.026385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.026932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.027496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.292803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.305716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.310691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a29240b-a3b9-40fd-a84c-5bfdcf00fd0a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.331908 Aug 31 12:38:25.312118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1105/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:25.320626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:25.321881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:25.323521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f84897f-ac34-4a1f-aff6-fe4d27e716c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.312269 Aug 31 12:38:25.325619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1122/2227] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:25.333628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.334471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.335262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.336144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:25.336556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.337445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.338147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:25.338347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.352707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.353550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.354268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.355457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:25.356198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:25.357036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:25.471736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.488114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.491146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.493373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb052053-6b9e-40b4-ba3a-fd9e2a0ace74 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.179774 Aug 31 12:38:25.494400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1106/2228] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:25.605096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:25.621064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-01bd88b9-d223-4b18-836f-73a66f50416a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.293169 Aug 31 12:38:25.622195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1123/2229] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:25 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:26.364535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.365691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.366299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.366492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.374030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.374618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.375216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.376241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.376869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.377410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.377823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.378679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.379470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.380752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.381598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.382352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.616271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.628121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.632247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf19389c-cfbe-47ea-a22c-969c4fcb8a14 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.271264 Aug 31 12:38:26.632537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:26.633944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1124/2230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:26.644700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.645065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02f4c228-5a10-4b71-b04f-92619c0c8edf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.287623 Aug 31 12:38:26.645828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.659380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1107/2231] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:26.659380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:26.659877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.660073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:26.660241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.660241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.661237 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.662054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.662812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.670775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.671680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.672381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.673584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:26.674390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:26.675095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:26.788513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.801366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.803047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.804580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e2eace5-5f69-4210-9aa9-f76ef65ee363 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.168738 Aug 31 12:38:26.805414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1125/2232] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:26.945099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:26.954854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a9cad156-0cde-4e73-bd01-5c6676d0f43e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.306549 Aug 31 12:38:26.955612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1108/2233] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:26 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:27.668702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:27.669900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:27.678384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:27.679044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:27.679807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:27.680731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:27.681310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:27.681902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:27.690107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:27.691215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:27.704192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:27.705089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:27.705921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:27.707393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:27.708447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:27.709227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.406363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.416831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1028944d-05d0-4dee-9fab-7dfcf52fc647 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.752011 Aug 31 12:38:28.417526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1126/2234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:28.420768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.424304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:28.425246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:28.433755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.434850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.435522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2429a69d-6865-4467-9899-b82407db156d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.753076 Aug 31 12:38:28.435833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.436660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.437350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1109/2235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:28.437547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.438248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.446010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:28.447428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:28.459509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.460222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.460857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.462335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:28.463314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:28.463961 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:28.538189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.554627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.557757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.560332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d63b1c85-075d-4c27-92e2-aa2eba58bece tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.141299 Aug 31 12:38:28.561405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1127/2236] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:28.663814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:28.678294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-736ce1b4-f69c-46ff-bb10-9a9d174bda0e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.238643 Aug 31 12:38:28.679165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1110/2237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:28 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:29.463536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.464653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.474429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.475454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.476659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.477521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.478623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.479911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.480916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.481696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.486559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.487352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.488035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.489140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.489871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.490622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.856885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:29.866263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:29.872946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2eaf9bfd-39f9-4ddd-b19d-38927a860813 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.416636 Aug 31 12:38:29.875044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1128/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:29.882712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2f21e327-e18f-4c0d-b4c5-22b342278711 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.415019 Aug 31 12:38:29.884327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1111/2239] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:29.894038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.895921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.896203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:29.897512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:29.911090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.912088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.912974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.913885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.914440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.914891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.915567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.915747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.916435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:29.916975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:29.917769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:29.918513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.047500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.063384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.066084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.068036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-46c2ab64-0435-46dc-af42-b674a5c3f5be tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.186558 Aug 31 12:38:30.068930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1129/2240] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:30.190430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:30.211206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d6ba1fa1-9f8d-414d-988c-6baad05739ed tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.323768 Aug 31 12:38:30.212277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1112/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:29 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:30.913712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:30.915124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:30.924850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:30.926026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:30.927435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.928289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.929139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.930386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.931219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.931999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.939343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.940158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.940980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:30.942360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:30.943495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:30.944264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.282932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.295581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.299537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-67f31cf5-359b-4ba9-b620-de3568038ff5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.392798 Aug 31 12:38:31.300730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1130/2242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:31.309430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:31.310875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:31.315495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09ede51c-cb48-4c32-876f-651b6d3aada0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.397935 Aug 31 12:38:31.316765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1113/2243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:31.322025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.322817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.323614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.324659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.325487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.325705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:31.326235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.326972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:31.337634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.339086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.340131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.341449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:31.342298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:31.343532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:31.465227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.480516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.482948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.485040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e78edf7f-e102-4459-956b-0ffa6c0f837b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.182625 Aug 31 12:38:31.485909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1131/2244] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:31.628823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:31.643453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-753fd298-b3a3-457c-bf8e-5a768ba12a50 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.324760 Aug 31 12:38:31.644421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1114/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:31 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:32.344676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:32.345664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:32.356600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.357063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:32.357816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.358025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.358290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:32.359604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.360069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.360742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.362716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=86 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:32.372207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.372973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.373836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.375279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.376035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.376698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.688470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.696437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.698739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f2a83621-7356-4564-a20f-0f86294d43e4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.361166 Aug 31 12:38:32.699614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1132/2246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:32.705292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:32.706100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:32.713975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.714667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.715210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.716164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.716873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb263e88-da90-4454-9382-eb6ae81183b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.366832 Aug 31 12:38:32.717102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.717537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.718246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1115/2247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:32.728510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:32.729499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:32.740327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.741933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.743045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.744264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:32.744999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:32.745682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:32.809098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.813349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:32.820166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.821645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.822942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03a1d016-6916-428e-a910-cab8535441ba tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.122056 Aug 31 12:38:32.823557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1133/2248] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:32.974026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:32.989908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c32091ab-31b9-4365-b63a-00b46048aba6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.269559 Aug 31 12:38:32.990986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1116/2249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:32 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:33.749883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:33.751003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:33.756039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:33.757180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:33.761128 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.761887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.762557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.763705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.764399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.765107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.769281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.770118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.770896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:33.772242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:33.773108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:33.773863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.129027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.144197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.144550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0f4cc576-883f-4a2e-aa47-62ef2a97b15f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.401780 Aug 31 12:38:34.145447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1134/2250] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:34.153143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:34.154102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:34.161860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=86 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:34.165672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:34.166442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:34.167105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.167428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1a238285-0b4d-4474-9663-c3f450bfaa8c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.419351 Aug 31 12:38:34.168270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:34.168893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1117/2251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:34.172205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:34.173015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.177269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:34.178345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:34.189569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:34.190406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:34.191151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.192455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:34.193298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:34.194043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:34.312429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.327702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.330440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.332366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d00928c1-8e3f-4fbd-89b0-d39a8dee8bcf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.185519 Aug 31 12:38:34.333585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1135/2252] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:34.479457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:34.496399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2777bb1-387d-4ab2-87f5-86a6a30b92c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.325834 Aug 31 12:38:34.497443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1118/2253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:35.187013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:35.188140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:35.200383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.201240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.201958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.202925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:35.203860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.204322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:35.204526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.205205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.216139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.216971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.217702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.218945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.220580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.221266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.558779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.563279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.576288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b63ee4c3-2297-4d28-944d-84187b12630c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.399364 Aug 31 12:38:35.577848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1136/2254] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:35.579211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0a350356-19d2-473b-91a7-9dde64c4f9c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.382915 Aug 31 12:38:35.580615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1119/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:35.587033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:35.588100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:35.596334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:35.598704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:35.599618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.600404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.601105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.602454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.603175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.603901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.615610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.616464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.617224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.618485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:35.619323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:35.620097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:35.856419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.870968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a60b55a4-6645-4fe5-a39f-24bc9911af3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.288547 Aug 31 12:38:35.877124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1120/2256] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:35 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:35.939071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.954455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.957309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:35.959526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ceabf9b-2ea9-43d4-ae2d-6873efb613ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.379927 Aug 31 12:38:35.960568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1137/2257] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:36.616735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:36.617856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:36.622012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:36.623035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:36.630943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.631807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.632572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.633814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.634026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.634596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.634820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.635377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.635569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.636435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:36.637129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:36.637767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:36.973420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:36.979107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:36.987595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e41b9cb8-afc8-4b6c-833f-afc38657c964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.376539 Aug 31 12:38:36.988489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1121/2258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:36.994306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c8ae35d2-1e88-467a-9fd4-8aa809d27ff5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.377895 Aug 31 12:38:36.995489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1138/2259] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:36.996295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:36.997235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:37.007529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:37.009517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:37.013503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:37.014700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:37.015783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:37.016662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:37.017367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:37.018038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:37.022273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:37.023134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:37.023991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:37.025292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:37.026409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:37.027317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:37.175595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:37.190723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:37.193346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:37.195214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdc96648-7865-4fac-aeaf-0f9d8fb38d0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.196151 Aug 31 12:38:37.197136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1139/2260] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:37.292453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:37.306895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-88ef0ee5-6201-4efc-9314-5d878d717b40 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.316664 Aug 31 12:38:37.307997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1122/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:36 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:38.022443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:38.023440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:38.030423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:38.031582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:38.034469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.035208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.035909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.037004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.037695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.038333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.043960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.044473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.044962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.046170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.046993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.047775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.310107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:38.317754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:38.321633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4a3eb0d-fc49-46f9-9e95-55bbd5a1d448 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.305584 Aug 31 12:38:38.322759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1140/2262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:38.327752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:38.328367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:38.335616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7b2c953-eaed-4d61-b6b9-743bf6afe976 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.312454 Aug 31 12:38:38.336646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1123/2263] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:38.337360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.337888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.338331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.339062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.339550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.339976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.348183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:38.349263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:38.359640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.361374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.362486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.364108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:38.364927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:38.365652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:38.393201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:38.473325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:38.490926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:38.494096 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:38.496263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbc7142a-98ef-4a25-8d0c-611a4e192bf4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.172095 Aug 31 12:38:38.497339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1141/2264] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:38.564447 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:38.580899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ddb4a26f-d5ed-45ce-97f4-3c557895cd1e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.239352 Aug 31 12:38:38.582370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1124/2265] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:39.359985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:39.361833 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:39.372454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.373183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.373821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.374944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.375418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:39.376177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.376329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.376653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:39.386886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.387652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.388312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.389453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.390165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.390829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.740331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:39.748695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:39.754313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3df3d259-1660-4fe6-9edd-fa796cb83ee3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.401160 Aug 31 12:38:39.755202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1142/2266] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:39.762842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:39.763883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:39.766269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dca919c2-9a6b-4cb1-9b3b-843f486c2edc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.396977 Aug 31 12:38:39.767766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1125/2267] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:39.774617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.775382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.776312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.777608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.778379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:39.778834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.779716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:39.779946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.791467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.792489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.793647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.795272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:39.796091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:39.796853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:39.901562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:39.919428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:39.922499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:39.925207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5a6cbccf-5e81-4c71-9eb1-1aa00e8f4711 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.168417 Aug 31 12:38:39.926222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1143/2268] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:40.065803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:40.079593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-938c3807-e8d6-47e0-8bf4-ded19ee85d56 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.309692 Aug 31 12:38:40.081185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1126/2269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:39 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:40.789917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:40.791024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:40.802839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:40.803714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:40.803989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:40.804477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:40.805233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:40.806320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:40.807099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:40.807845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:40.817164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:40.818011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:40.818797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:40.820116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:40.820928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:40.821663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:41.087911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:41.094016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:41.110671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-10f175b7-269f-4d33-924b-3fc4a947da58 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.327807 Aug 31 12:38:41.111003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6c10e397-de5a-4452-979b-f0af664d54ee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.315841 Aug 31 12:38:41.111708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1144/2270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:41.123650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1127/2271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:41.123993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:41.123993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:41.124304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:41.124304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:41.133296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:41.134087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:41.134878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:41.136234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:41.137645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:41.137952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:41.140575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:41.140575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:41.140575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:41.141559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:41.142343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:41.144278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:41.272725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:41.287091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:41.289977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:41.292217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f55d80bd-871b-4fd2-b98f-af0a68ad3c8e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.178861 Aug 31 12:38:41.293526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1145/2272] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:41.445142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:41.466784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3a4badce-25d2-4926-a9af-9a3ff11832e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.352899 Aug 31 12:38:41.467943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1128/2273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:41 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:42.153883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:42.154864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:42.157825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:42.158824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:42.166954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.167819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.168573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.170547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.170763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.170944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.171132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.171352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.171625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.171819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.172534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.173186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.476504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:42.492831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b83e88e-cc4c-4219-954c-23149484352a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.341335 Aug 31 12:38:42.494529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1129/2274] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:42.494783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:42.504566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:42.505972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:42.511496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e0f61bc7-05d8-413c-a26b-c4258202ff28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.365111 Aug 31 12:38:42.512556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1146/2275] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:42.527501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.527501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.527501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.527501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.528230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.528230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.529001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:42.530139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:42.540679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.541173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.541726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.542537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:42.543094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:42.543653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:42.659760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:42.676850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:42.679459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:42.681352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-45a05ce5-b35a-46fc-92c0-b2fbe4f84d42 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.183741 Aug 31 12:38:42.682195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1130/2276] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:42 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:42.821448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:42.837722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d500e4bb-e616-466d-82d4-b994d10a6f88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.315491 Aug 31 12:38:42.838771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1147/2277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:42 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:43.532928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:43.534046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:43.547053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.547893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.548677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.550365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:43.551094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.551094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.551541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:43.551752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.564172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.565342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.566156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.567583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.568105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.569006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.931109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:43.938141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:43.945859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3efde696-de7e-4bc3-ae32-2d91e5b9d2e9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.402862 Aug 31 12:38:43.946754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1148/2278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:43.953351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:43.953958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:43.954833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7ad4164a-0b57-4c83-a83b-0590a4bad896 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.429279 Aug 31 12:38:43.955789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1131/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:43.960362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:43.960985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:43.973377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.973934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.974129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.974638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.974914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.975669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.975866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.976307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.976908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:43.977098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:43.977734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:43.978540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:44.133711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:44.144154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:44.145607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:44.146798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-998a138c-ed20-49c6-bfd1-baf3ecb6d3b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.198490 Aug 31 12:38:44.147411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1149/2280] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:44.247511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:44.264397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7439c785-f261-4d23-89e6-62b4439eb664 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.307536 Aug 31 12:38:44.265433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1132/2281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:43 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:44.981631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:44.983090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:44.984577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:44.985853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:44.995524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:44.996370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:44.996962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:44.997166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:44.997785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:44.998288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:44.998476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:44.999075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:44.999678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:44.999933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:45.000417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:45.001110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:45.036633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:45.333586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:45.341029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:45.343598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-98e55c35-d37b-4fd7-979f-08c48f08f601 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.365559 Aug 31 12:38:45.344320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1133/2282] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:45.349618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:45.350293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:45.355951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-670eb1b3-7206-443d-a9cd-67f2b907f20b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.381287 Aug 31 12:38:45.356845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1150/2283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:45.357197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:45.357693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:45.358304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:45.359042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:45.359536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:45.359965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:45.367654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:45.369171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:45.379502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:45.380754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:45.381485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:45.382485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:45.382962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:45.383573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:45.456312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:45.467735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:45.469217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:45.470445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b89680b7-6022-407c-872d-666693e2220d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.125257 Aug 31 12:38:45.483271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1134/2284] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:45.662937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:45.674814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c457aff1-f8be-4cbb-8695-c854a42ff3b3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.315350 Aug 31 12:38:45.675698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1151/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:45 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:46.388494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:46.389649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:46.393326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:46.394434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:46.401315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.402085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.402759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.403929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.404636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.405307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.415465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.416320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.417265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.424304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.425219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.427480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.804641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:46.819838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:46.823777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06841c32-6f11-4a3c-880c-ec9fb05fba85 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.442953 Aug 31 12:38:46.824688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1135/2286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:46.833379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:46.834530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:46.846722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.848603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.850402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.852109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bde55c46-f3e1-4e52-900b-04a4cba9b9e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.466038 Aug 31 12:38:46.852566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.853446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.854247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.857714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1152/2287] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:46.867137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:46.868580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:46.880111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.880952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.881712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.882954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:46.883807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:46.884743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:46.979920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:46.996575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:46.999648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:47.001859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8482d89-4d9d-4098-8030-98b6fd19d1d2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.175498 Aug 31 12:38:47.002916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1136/2288] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:47.136907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:47.151416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0bd04c55-e039-4f97-b28f-c88b3094c040 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.291793 Aug 31 12:38:47.152208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1153/2289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:46 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:47.868937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:47.870032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:47.882352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:47.883097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:47.883887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:47.885099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:47.886152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:47.886877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:47.888977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:47.890115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:47.903225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:47.904305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:47.905075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:47.906459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:47.907305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:47.908073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:48.227676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:48.241574 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d9c8c59-65a4-41af-9f4a-995f058e29de tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.379739 Aug 31 12:38:48.243033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1137/2290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:48.249305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:48.250823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:48.251820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:48.262064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:48.262811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:48.263607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:48.264923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:48.265632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:48.266273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:48.267011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cde1e0ff-8bfc-4c46-b7ed-27157c9593f2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.384634 Aug 31 12:38:48.268184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1154/2291] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:48.277595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:48.278867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:48.290996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:48.292035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:48.292801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:48.294423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:48.295013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:48.296037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:48.384955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:48.401137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:48.403694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:48.407612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c38b7ff3-38e7-43cb-9a90-4c83872828cc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.163000 Aug 31 12:38:48.419463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1138/2292] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:48.562940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:48.580382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee3e78a9-49f7-4bb9-98fa-ae41502986c3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.309953 Aug 31 12:38:48.581361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1155/2293] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:48 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:49.282003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:49.283069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:49.294861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.295764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.296537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.297793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.298607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.299362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.302478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:49.303956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:49.315545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.316680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.317603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.318923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.319774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.320642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.641998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:49.660830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25ba7b17-da15-41de-94c9-347ffe9fbfe6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.385398 Aug 31 12:38:49.662278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:49.670376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1139/2294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:49.679347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:49.680383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:49.680588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7cff000c-544e-4be4-8ff8-c13b3eec396e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.385066 Aug 31 12:38:49.681920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1156/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:49.689591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:49.690585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:49.700675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.701034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.701457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.701650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.702041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.702240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.703170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.703393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:49.703897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.704109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:49.704538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.704765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:49.856995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:49.873972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:49.876914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:49.881134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-122c9a17-5e77-4e48-b09d-7bf1f4b29136 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.207759 Aug 31 12:38:49.882227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1140/2296] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:49.980964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:49.995472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-90872245-c016-46fe-a019-c384d2eca325 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.312231 Aug 31 12:38:49.996389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1157/2297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:49 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:50.707118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:50.708328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:50.720546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:50.721579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:50.721970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:50.722653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:50.723070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:50.723955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:50.724875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:50.725916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:50.735414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:50.735820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:50.736750 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:50.737663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:50.738949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:50.739886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:50.740634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:51.050573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:51.065017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-352c3d98-4a8c-425e-bc36-35368372f517 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.365730 Aug 31 12:38:51.065773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1141/2298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:51.066158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:51.077268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:51.078629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:51.084734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4f70621-dee8-42f4-9cfb-60ce68208f85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.369957 Aug 31 12:38:51.086150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1158/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:51.090974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:51.091866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:51.092719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:51.093957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:51.094663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:51.094877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:51.095577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:51.095987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:51.107152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:51.108289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:51.109068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:51.110360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:51.111183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:51.111973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:51.185261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:51.197617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:51.199104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:51.200494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c3fe49ab-2b69-4505-a06f-8c4d26066d1f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.131625 Aug 31 12:38:51.201079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1142/2300] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:51.696046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:51.706207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5ef9f13e-44be-4d5b-9168-8fc4693c6f94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.618759 Aug 31 12:38:51.706861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1159/2301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:51 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:52.128616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:52.129758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:52.141926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.142731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.143391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.144509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.145239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.145972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.330134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:52.331167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:52.339558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.340124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.340483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.341207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.341664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.342087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.372338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:52.388944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d45c6de2-b2d1-465c-a5c9-6ad1427e8b45 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.267053 Aug 31 12:38:52.390790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1143/2302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:52.397567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:52.398389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:52.406564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.407706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.408376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.409849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.410904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.413364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.524118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:52.535546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:52.537624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:52.539137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5e88046c-112c-4a93-8145-edcb51fcd9c1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.146956 Aug 31 12:38:52.539901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1144/2303] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:52.560775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:52.570831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72c1449d-3adb-4abb-87eb-6381ca5eb94d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.448566 Aug 31 12:38:52.571506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1160/2304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:52.733240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:52.734277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:52.743528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.744151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.744672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.745608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:52.746171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:52.746785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:52.911690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:52.921241 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13deaaaa-7775-494f-880d-8d34b027ea2d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.195085 Aug 31 12:38:52.921983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1145/2305] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:52 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:53.422523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:53.423191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:53.430809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.431338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.431775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.432499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.432957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.433377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.579535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:53.580335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:53.588217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.588918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.589552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.590464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.591022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.591579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.635694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:53.646982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b3b0645-aa16-4aff-89fb-a3dd8fa90195 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.228354 Aug 31 12:38:53.647755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1161/2306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:53.661093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:53.662727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:53.674999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.676104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.677067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.679288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.680262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.681486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.701871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:53.713088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:53.714649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:53.715970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-25a7845d-ca84-47ba-a058-9a17f965651b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.141999 Aug 31 12:38:53.716590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1146/2307] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:38:53.875920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:53.888388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f07d1348-1806-47b1-bea5-dc157f2f0dbd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.239094 Aug 31 12:38:53.895982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1162/2308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:53.947718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:53.948327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:53.957378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.957890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.958600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:53.959674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:53.960457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:53.961149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:54.190971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:54.201918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ab65c7d-e125-47f3-818b-8d051ee09b8e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.259110 Aug 31 12:38:54.202676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1147/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:53 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:54.683839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:54.684779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:54.692391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:54.693360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:54.694441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:54.695541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:54.696071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:54.696538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:54.743307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:54.744326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:54.755835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:54.757040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:54.758059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:54.759347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:54.760199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:54.760983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:54.861579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:54.881588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:54.884687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:54.886870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-916fb0cc-3cf6-4c7a-a626-2c60c9d35831 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.150127 Aug 31 12:38:54.887942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1148/2310] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:38:54.902001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:54.916264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-96c06bbc-4e0c-4bc9-a5f2-8adaf1e5c424 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.236921 Aug 31 12:38:54.917042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1163/2311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:54.919929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:54.921101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:54.933619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:54.934506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:54.935320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:54.936583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:54.937400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:54.938184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:55.135730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:55.145870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d9f175a2-8fcd-47f9-bac1-41d252d5ff39 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.234442 Aug 31 12:38:55.146639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1149/2312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:55.235424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:55.236588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:55.248774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:55.249588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:55.250361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:55.251707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:55.252504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:55.253277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:55.456636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:55.473202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-db37a7f6-dbb4-464c-9e88-b108780586a4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.242254 Aug 31 12:38:55.474260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1164/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:55 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:55.925549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:55.926674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:55.936674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:55.937496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:55.938226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:55.939545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:55.940232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:55.940927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:55.947298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:55.948360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:55.958970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:55.959808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:55.960567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:55.961785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:55.962531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:55.963289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.056784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:56.075316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:56.078632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:56.081065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab7860e1-a407-450e-9157-208c959ca0cf tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.162789 Aug 31 12:38:56.082270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1150/2314] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:56.160194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:56.171879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:56.172259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-403c1c0e-f5e8-4e25-910b-0c8c45d15fb2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.232408 Aug 31 12:38:56.172784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1165/2315] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:56.173312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:56.185079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:56.185946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:56.186712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.188011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:56.188846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:56.189589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.370387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:56.380991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-42f9b96b-dbfa-4b0f-b447-44e61898c230 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.216273 Aug 31 12:38:56.381596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1151/2316] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:56.506066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:56.507715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:56.519603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:56.520475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:56.521242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.522718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:56.523615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:56.524387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:56.725575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:56.735640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb5d3371-49b9-420f-818f-744bfc66842d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.237056 Aug 31 12:38:56.736242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1166/2317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:56 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:57.121662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:57.122562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:57.130421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.130954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.131505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.132404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.132903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.133388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.199319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:57.200432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:57.213327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.214150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.214915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.215462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.216207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.216989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.217742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.225357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:38:57.232741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.235547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.237698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14120d5a-cd85-45ce-81c6-53f979a45595 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.120633 Aug 31 12:38:57.238640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1152/2318] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:57.405548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.406266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:57.407007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:57.414776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.415316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.415767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.416535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.416998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.417434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.421155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7b4256be-4f61-4351-8510-2ca012b1659e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.229374 Aug 31 12:38:57.422498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1167/2319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:57.759967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:57.761007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:57.771590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.772490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.773276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.774495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:57.775034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.775258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:57.775865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:57.790167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08fff886-78c1-443e-a042-7b8c1305eae4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.388655 Aug 31 12:38:57.791221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1153/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:38:57.980301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:57.989608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-edc04eed-2d47-459f-8af6-a857d8d7f454 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.234963 Aug 31 12:38:57.990269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1168/2321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:57 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:58.263958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:58.264919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:58.272485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.273006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.273978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.274354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.274791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.275263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.346518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:58.358382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:58.360344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:58.361788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d641db5-d637-4240-a65b-2dd324481e14 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.102253 Aug 31 12:38:58.362482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1154/2322] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:58 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:58.461084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:58.462213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:58.474753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.475264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.475728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.477347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.477817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.478242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.667034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:58.678657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09613c1f-906f-41fd-aba1-2626479fc98c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.224742 Aug 31 12:38:58.680259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1169/2323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:58 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:58.826132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:58.826793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:58.834503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.834994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.835476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.836254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:58.836701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:58.837122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:58.987858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:58.997477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a215fc1d-fb33-4520-b4fa-6ac2be3d0968 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.175651 Aug 31 12:38:58.998119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1155/2324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:59.012704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:59.013323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:59.020714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:59.021227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:59.021658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.022352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:59.022806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:59.023267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.180755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:59.190069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c878fdbf-32e7-40da-9f96-f2656a414c83 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.181257 Aug 31 12:38:59.190850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1170/2325] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:59 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:38:59.386325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:59.387012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:59.395749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:59.396549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:59.397287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.398949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:59.399773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:59.400466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.490523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:59.500487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:59.501927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:59.503157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-87ca1adb-87d8-4288-a40d-cfad8b737e1a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.121191 Aug 31 12:38:59.503745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1156/2326] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:38:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:38:59.718079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:38:59.718742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:38:59.725951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:59.726568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:59.727149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.727988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:38:59.728434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:38:59.728862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:38:59.916965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:38:59.926438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6f624b1-b5b8-4ca0-b2e7-c08d06466c06 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.212709 Aug 31 12:38:59.927003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1171/2327] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:38:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:00.019161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:00.019980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:00.027203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.027776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.028248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.029083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.029572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.030101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.186867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:00.193227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:00.204023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-615b0f4d-ceb2-4d48-ad7f-49f5e3757e54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.188353 Aug 31 12:39:00.205238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1157/2328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:00.214131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:00.214740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:00.221324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.221790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.222236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.222926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.223419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.223837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.384540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:00.394637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49801c48-b149-4eac-b5e3-14e95cf637a8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.184622 Aug 31 12:39:00.395403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1172/2329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:00 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:00.528015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:00.528686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:00.536656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.537197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.537634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.538362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.538816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.539394 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.624645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:00.639625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:00.642530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:00.644724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a76e7ef3-82d5-4314-8bde-00c126c12898 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.121015 Aug 31 12:39:00.645615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1158/2330] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:00.949286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:00.949956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:00.957483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.957960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.958413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:00.959124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:00.959619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:00.960038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.114966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.124529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ab173dc2-3d9e-4b3d-aa7e-90e65c760510 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.179898 Aug 31 12:39:01.125192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1173/2331] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:01.238413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:01.239136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:01.247173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.248167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.248885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.249878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.250548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.251158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.417265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:01.417886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:01.424857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.425343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.425775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.426480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.426923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.427367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.463183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.472563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f8af5f9-2dbd-40c7-86cd-886ba714645f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.238092 Aug 31 12:39:01.473133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1159/2332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:01.628835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.638826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d6cef48-f510-494e-927e-1c0093bf0870 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.225487 Aug 31 12:39:01.639454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1174/2333] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:01 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:01.682631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:01.683332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:01.690688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.691362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.691762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.692514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:01.693014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:01.693493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:01.765035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.775479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.776980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:01.778185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a6832f7c-0c9b-4824-b32f-ec31bb44186b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.099716 Aug 31 12:39:01.778799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1160/2334] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:02.147495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:02.148103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:02.155111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.155527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.155965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.156671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.157137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.157545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.319068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:02.327486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3127629a-a2d8-47c3-8d75-389c630d5103 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.184283 Aug 31 12:39:02.328082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1175/2335] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:02 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:02.494837 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:02.495524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:02.497610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=92 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:02.503644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.504128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.504571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.505416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.506011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.506405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.662244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:02.662867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:02.669723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.670205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.670635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.671381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.671831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.672247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.685134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:02.699041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55fcdb98-2d57-47db-bb26-e7cecc5ee7cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.208283 Aug 31 12:39:02.700260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1161/2336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:02.802460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:02.803403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:02.810660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.811558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.812135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.812997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:02.813621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:02.814177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:02.863111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:02.875801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a5c36d8-3fd9-4950-a545-a7b744546c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.217650 Aug 31 12:39:02.878700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1176/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:02 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:02.908815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:02.919046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:02.920773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:02.921848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77bf2993-2f96-4b08-b32c-ca2bb28f7974 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123998 Aug 31 12:39:02.922466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1162/2338] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:03.351081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:03.352467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:03.361221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.361807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.362434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.363272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.363837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.364349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.522341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:03.532095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-571001ca-5795-4294-accd-3474f7152b73 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.186136 Aug 31 12:39:03.532691 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1177/2339] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:03.725436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:03.726234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:03.733109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.733666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.734138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.734900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.735441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.735903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.910519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:03.910884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:03.911592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:03.918324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.918820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.919297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.920243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.920371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f80a3e21-6507-45c1-b80f-b02fd202cc78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.198847 Aug 31 12:39:03.921029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1163/2340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:03.921327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.921860 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.964589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:03.965794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:03.977411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.978410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.979302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:03.980704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:03.983192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:03.983958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:04.094606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:04.112830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:04.116225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:04.118760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7ceda52c-7ce9-4b14-8ed0-b0003a4ece62 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.160857 Aug 31 12:39:04.120438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1164/2341] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:03 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:04.147699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:04.164462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-628fa26c-1522-4dc2-9d39-de4284e44fc8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.259650 Aug 31 12:39:04.167146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1178/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:03 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:04.553847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:04.554449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:04.561687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:04.562185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:04.562627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:04.563383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:04.563846 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:04.564275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:04.736428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:04.747947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c8e09518-d9a7-4018-b14f-b544a440434b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.198186 Aug 31 12:39:04.748543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1165/2343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:04.949487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:04.950127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:04.952924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=88 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:04.959666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:04.960357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:04.960914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:04.961777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:04.962471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:04.963797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.122389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.132025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b6b03c4-90a1-4e0c-9ec2-1e04701dd892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.187957 Aug 31 12:39:05.132596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1179/2344] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:05.142366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:05.142976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:05.150909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.151434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.151864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.152598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.153036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.153429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.200310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:05.201172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:05.209010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.209501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.209936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.210640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.211082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.211531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.252803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.262966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.264522 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.265727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f767337-852b-47f7-a6db-8640f84965f9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.127372 Aug 31 12:39:05.266552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1166/2345] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:05.408633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.424002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ddd3d33-fd4c-497e-8d9e-8a3dd32fc2bb tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.228559 Aug 31 12:39:05.425129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1180/2346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:05 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:05.774941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:05.776095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:05.783799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.784289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.784723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.785457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:05.785989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:05.786480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:05.961342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:05.978451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a0bfdbd-9121-46a5-886c-7348242d1e79 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.209540 Aug 31 12:39:05.980357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1167/2347] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:06.157789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:06.158682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:06.167141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.167893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.168585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.169530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.170192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.170727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.295252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:06.296366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:06.308271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.309159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.309892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.311167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.312018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.312763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.338354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:06.349445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-727fccaf-e8a6-4564-985f-918798f86d7c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.195983 Aug 31 12:39:06.350043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1181/2348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:06.407321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:06.417139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:06.418521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:06.419768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a664b8d9-9c0f-4582-9a6d-d5695ff3e321 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.131816 Aug 31 12:39:06.420345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1168/2349] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:06.460394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:06.461009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:06.468585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.469151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.469622 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.470348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:06.470783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:06.471216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:06.619476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:06.629925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e6c37b21-7ba5-4a5a-b182-2d7e138d20e4 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.173536 Aug 31 12:39:06.630532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1182/2350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:06 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:07.007034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:07.008528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:07.015940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.016701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.017225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.018067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.018610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.019170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.166851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.176074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0b807703-65e9-4f2e-8b3f-3ae30068f0d9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.173530 Aug 31 12:39:07.176739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1169/2351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:07 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:07.377003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:07.377666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:07.385107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.385685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.386097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.386834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.387346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.387727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.451936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:07.452726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:07.465468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.466290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.467209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.468477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.469297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.470033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.552832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.557082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:07.564631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4296dc37-4342-4a35-9352-fc707560e057 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.191491 Aug 31 12:39:07.565554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1183/2352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:07.573687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.584654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.586191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.587495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-625186e0-ccdb-4e0d-b0fc-1184f77dbde9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.140168 Aug 31 12:39:07.588190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1170/2353] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:07.652708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:07.653384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:07.660722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.661235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.661688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.662479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:07.663030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:07.663498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:07.851141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:07.861010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ef90811-9315-4108-b666-21b449dd08d2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.212689 Aug 31 12:39:07.861609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1184/2354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:07 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:08.198957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:08.199732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:08.206626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.207141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.207791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.208530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.208993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.209425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.376323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:08.386428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e69bad8b-3a59-4285-bcdf-0659c554e706 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.192067 Aug 31 12:39:08.387067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1171/2355] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:08.591804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:08.592569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:08.600764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.601253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.601702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.602590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.603045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.603493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.615476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:08.616623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:08.628900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.629848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.630582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.631901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.632740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.633514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.756144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:08.769145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:08.771882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:08.773843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13775738-1896-4187-a413-7348679993fc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.165905 Aug 31 12:39:08.774749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1172/2356] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:08.847418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:08.860106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8eb4064c-f496-4f8e-a1b3-6641e36eb4db tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.273486 Aug 31 12:39:08.860762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1185/2357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:08.894644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:08.895731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:08.902799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.903451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.903951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:08.904735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:08.905334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:08.905873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.074211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:09.084508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca957b38-78da-4279-8627-c85a34c0b095 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.194408 Aug 31 12:39:09.085269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1173/2358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:08 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:09.409709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:09.410287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:09.417231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.417786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.418259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.419180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.419714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.420181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.623864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:09.636873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-45136887-4578-491d-b32a-db30b3e0db0b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.231088 Aug 31 12:39:09.637945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1186/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:09.812963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:09.813619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:09.823326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.824052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.824662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.825725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.826288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.826939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.848754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:09.884404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:09.886402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:09.898683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.900367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.900599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.902298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:09.903152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:09.903994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:09.921683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:09.934482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:09.936291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:09.937701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f5a74f52-e93f-4fa1-b8c8-0200fbff34b4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.130345 Aug 31 12:39:09.938373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1174/2360] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:10.074594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:10.089135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fcc91fe-82c8-4f80-a901-7acf34b65c87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.209514 Aug 31 12:39:10.090050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1187/2361] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:10.117064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:10.117944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:10.125053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.125518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.125966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:10.126675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.127128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.127589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:10.309056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:10.319565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-12468b39-309c-4575-a3fd-e282b0f858fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.207204 Aug 31 12:39:10.320319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1175/2362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:10 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:10.679149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:10.680235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:10.693092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.693985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.694773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:10.696093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.696945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.698351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:10.930914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:10.945489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bf4afa35-ec8e-49de-9986-1f8cf1ab46f4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.273562 Aug 31 12:39:10.946574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1188/2363] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:10.967604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:10.968527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:10.975554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.976047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.976531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:10.977253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:10.977707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:10.978124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.055583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:11.072249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:11.076073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:11.078178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b5385998-9033-4c63-8384-7294a364f96b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.115461 Aug 31 12:39:11.079213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1176/2364] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:11.119766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:11.120465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:11.128612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:11.129311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:11.129959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.131059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:11.131771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:11.132400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.307702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:11.317494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-596117e2-95f8-4a52-9b8a-c2dd60a5e527 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.202912 Aug 31 12:39:11.318153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1189/2365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:11.344443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:11.345176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:11.352128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:11.352623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:11.353051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.353751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:11.354196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:11.354654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.521214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:11.531404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-34d1e613-f011-4388-b1a6-cd6f0599129d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.191539 Aug 31 12:39:11.532249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1177/2366] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:11 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:11.971458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:11.972341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:11.984686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:11.985561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:11.986339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:11.987705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:11.988530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:11.989280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.107623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:12.108740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:12.120699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.121201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.121638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.122343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.122784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.123209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.242950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.255563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.257353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.258559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9bb9a50b-cd59-4c3d-af4e-9e38225d59a9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.159834 Aug 31 12:39:12.258771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.259472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1178/2367] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:39:12.274533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-088b3032-19d5-4e7f-94bf-d553ed2cf198 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.307106 Aug 31 12:39:12.275730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1190/2368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:12.346127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:12.347248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:12.362611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.363491 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.364237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.365467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.366299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.367046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.564123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:12.564759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:12.571118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.572559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.573829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.574092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.575144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:12.575900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:12.576342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:12.583002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-951a6140-37b5-4fbb-9444-12f596803fc4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.244795 Aug 31 12:39:12.583800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1179/2369] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:12.804341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:12.816354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2b7bb885-7e64-402f-9880-ac26c80ab6ff tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.259091 Aug 31 12:39:12.817458 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1191/2370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:12 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:13.284401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:13.285415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:13.294079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.294882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.295654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.296821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.297555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.298249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.301053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:13.301920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:13.311320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.311907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.312436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.313255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.313779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.314309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.414209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:13.428568 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:13.430463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:13.432146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8e51482a-bc97-44c4-95f8-643674676dd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.151844 Aug 31 12:39:13.433956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1180/2371] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:13.534528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:13.544347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f5e78a2-627d-41b0-9813-5ed7a6677087 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.249246 Aug 31 12:39:13.545042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1192/2372] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:13.620371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:13.622097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:13.629269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.629768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.630206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.630932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.631441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.631873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.836691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:13.845148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:13.846112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:13.853782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2884e8b2-4c92-43ca-91da-40fcd10968cf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.237142 Aug 31 12:39:13.854802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1181/2373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:13.856824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.857695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.858440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:13.859721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:13.860567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:13.861334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.056048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:14.066112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8eccdb75-df3a-4046-b9ab-159d7fd7290c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.227802 Aug 31 12:39:14.066754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1193/2374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:13 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:14.456793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:14.457425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:14.465183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.465806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.466259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.467919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.468426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.468892 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.561638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:14.567147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:14.567991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:14.571521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:14.573212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:14.575590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.576061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.576273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e14eef17-c187-4c08-9f9f-cd56e5a97902 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123235 Aug 31 12:39:14.576478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.577102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1182/2375] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:14.577314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.577656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.578083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.738259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:14.748162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6b6e04b-8486-4847-8822-d32cac6b9fd9 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.185082 Aug 31 12:39:14.748749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1194/2376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:14.893732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:14.894351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:14.901532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.902063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.902453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:14.903203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:14.903705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:14.904117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.058025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.068683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-261aac6f-a18b-433c-8ddb-ae094e6518d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.178965 Aug 31 12:39:15.069273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1183/2377] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:15.106522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:15.107683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:15.118429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.119213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.119981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.121322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.122100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.122854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.307859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.320876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8dee3f99-987f-4e0f-adba-8a059c6f37ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.222249 Aug 31 12:39:15.321556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1195/2378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:15 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:15.601204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:15.601874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:15.610483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.611054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.611523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.612239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.612678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.613110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.690939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.701547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.703026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.704264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a7d38d5-ce6d-40a8-884c-2a48e2de6f77 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.107867 Aug 31 12:39:15.704826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1184/2379] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:15 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:15.770842 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:15.771571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:15.780425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.781216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.781847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.783001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:15.783812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:15.784469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:15.971982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:15.987446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3df28803-40cc-45a9-9492-99c3763efd8a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.220264 Aug 31 12:39:15.988493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1196/2380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:16.092595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:16.093268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:16.100402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.101276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.101713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.102422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.102873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.103315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.258102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:16.274653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0f1775b-1910-4f5b-b336-23af6ce45e19 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.185776 Aug 31 12:39:16.275810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1185/2381] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:16.344284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:16.344898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:16.351961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.352841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.353379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.355450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.355450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.355450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.531404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:16.540436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c3a30678-70c8-4b87-8fbf-d3e33d2073f1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.200396 Aug 31 12:39:16.541036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1197/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:16 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:16.741989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:16.742900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:16.750683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.751220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.751730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.752565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:16.753231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:16.753706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:16.837287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:16.847472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:16.849026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:16.850257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b4381a6-dfc4-42ab-85bd-f050cf208cf0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.112641 Aug 31 12:39:16.850848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1186/2383] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:17.024476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:17.025114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.033368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.033865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.034295 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.035013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.035493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.035918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.224485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.234447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a1c85c8-a2e4-488d-bf5f-05bdcb23f068 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.214065 Aug 31 12:39:17.235043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1198/2384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:17.300856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:17.301383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.311023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.311661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.312154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.312953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.313556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.315127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.488742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.503819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57b41c43-9f9f-49c1-8a84-76a3b7c7e365 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.206653 Aug 31 12:39:17.504842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1187/2385] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:17.564283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:17.564869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.572219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.572766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.573242 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.574010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.574988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.575389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.770922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.781210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-072ce01a-5bf9-42d5-83df-43fc3c2ae6cf tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.221404 Aug 31 12:39:17.781814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1199/2386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:17 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:17.876396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:17.877156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:17.884866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.885359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.885794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.886519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:17.886971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:17.887539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:17.959038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.969214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.970991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:17.972223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4dfb452a-2888-4aa6-b9ac-19d673d8e4a2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.100923 Aug 31 12:39:17.972827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1188/2387] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:18.256820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.257494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.265744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.266236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.266677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.267430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.267884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.268307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.289807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:18.446559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:18.456834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8be88860-18a9-40f2-90e6-27ea96f5aaf5 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.204062 Aug 31 12:39:18.457454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1200/2388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:18.531111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.531728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.538838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.539775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.540193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.541005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.541513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.541960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.695757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:18.705260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0815b64-1967-4468-a9eb-56d94605c5c8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.179238 Aug 31 12:39:18.705864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1189/2389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:18.820070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.821053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:18.831135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.832008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.832579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.833376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:18.834156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:18.835013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:18.997525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:18.998431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:19.005653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.006140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.006589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.007423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.007980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.008490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.021201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.036340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-822ffc63-44a2-41c0-a180-9838f61b462e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.223274 Aug 31 12:39:19.037404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1201/2390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:19.088756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.098696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.100191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.101385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2669e87c-0a23-41ab-8d0e-c18d39d78ffb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.108209 Aug 31 12:39:19.101973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1190/2391] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:39:19.485331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:19.486401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:19.498408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.499258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.500009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.501205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.501947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.502698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.688712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.705065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f8633e6-ffb6-42ae-b57b-ec9804ca2616 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.226771 Aug 31 12:39:19.706118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1202/2392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:19.728289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:19.728903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:19.736566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.736967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.737410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.738121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:19.738566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:19.738989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:19.743656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:19.912988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:19.924048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2be6bd0b-a52a-43a4-94a2-db94b28dc7f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.199902 Aug 31 12:39:19.924651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1191/2393] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:20.067373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.067889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.074731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.076460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.076947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.077693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.078155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.078575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.129073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.130279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.142695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.143571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.144335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.145550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.146370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.147177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.285041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.292575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.298747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.301587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.303614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-699a217c-4e4f-4c12-8a99-0e6ad92641fe tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.181667 Aug 31 12:39:20.304564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1192/2394] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:39:20.305899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e41fff18-1dfc-48e4-aacc-a732ae35a72d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.242452 Aug 31 12:39:20.306818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1203/2395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:20.730847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.731546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.740957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.741769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.742490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.743723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.744559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.745327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.931591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:20.941147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-60e52749-4544-49af-86d2-dcc9b01f8b6b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.214624 Aug 31 12:39:20.941919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1193/2396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:20.952013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:20.952772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:20.962247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.962868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.963423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:20.964210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:20.964737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:20.965230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.119088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.129089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-44a6121c-260e-42e0-ac1e-14effd083b6f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.184716 Aug 31 12:39:21.130037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1204/2397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:21.330632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:21.331373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:21.333517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:21.334563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:21.339342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.339845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.340290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.341023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.342132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.342690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.345610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.346483 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.347318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.348505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.349379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.350209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.441639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.452442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.453943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.455180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f7ce0fe-ec6e-42e4-9fcf-39da8e9fcc2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.129894 Aug 31 12:39:21.455797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1194/2398] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:21.574570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:21.584808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b207840a-2c4e-45f1-ae78-406ef78c7967 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.258460 Aug 31 12:39:21.585345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1205/2399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:21 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:21.978243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:21.978859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:21.985766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.986252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.986715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:21.987467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:21.987905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:21.988341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.143997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.151837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:22.152736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:22.155277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f449155e-00c9-42c1-a1ad-c726f7f181c8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.180759 Aug 31 12:39:22.156060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1195/2400] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:22.161347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.161987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.162581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.163509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.164107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.164651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.331009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.342513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-253aa2cf-edcf-431a-93d7-116a42f7b1c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.194880 Aug 31 12:39:22.343148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1206/2401] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:22.478839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:22.479680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:22.487535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.488354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.488995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.489932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.490484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.491040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.567262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.585339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.588694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.590982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04a85705-135a-41d8-96c2-14bac7af88cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.115946 Aug 31 12:39:22.592094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1196/2402] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:22.608949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:22.609755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:22.617788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.618525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.619179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.620845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:22.621466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:22.621926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:22.782123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:22.791986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1006c4c4-8078-4fee-9548-ad627f77f650 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.187648 Aug 31 12:39:22.792702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1207/2403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:22 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:23.180110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:23.180636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:23.188589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.189108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.189555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.190273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.190728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.191150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.356240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.366524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f2c0a29-ae8c-4c74-bb81-ad62107347b1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.190435 Aug 31 12:39:23.367122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1197/2404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:23.371773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:23.373484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:23.386011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.387109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.387917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.390280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.390904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.391500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.545392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.555353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-031181a4-8e2d-4f01-8bb4-5d1275a590eb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.191114 Aug 31 12:39:23.555933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1208/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:23.629916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:23.630655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:23.638120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.638804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.640139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.640914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.641378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.641800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.740051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.750434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.751945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.753200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b10ee966-403d-40df-866d-24755667f895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.127571 Aug 31 12:39:23.753813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1198/2406] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:23 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:23.814348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:23.814980 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:23.821733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.822230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.822666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.823433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:23.823893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:23.824313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:23.983303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:23.992751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ed863c6-6e93-4ae3-8346-6bb1002548e0 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.182437 Aug 31 12:39:23.993255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1209/2407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:23 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:24.398082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:24.398663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:24.405924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.406417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.406836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.407581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.408015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.408449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.579285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:24.579940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:24.583708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:24.587270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.587767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.588217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.588932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.589382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.589814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.596237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-372545d4-a170-40f2-ac37-2a1c0ce79e19 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.202206 Aug 31 12:39:24.597022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1199/2408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:24 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:24.777945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:24.779043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:24.787657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.788306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.788866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.789077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:24.789896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:24.790915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:24.791688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:24.802589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e1078276-4362-4a9a-b18b-37a4defdb541 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.228070 Aug 31 12:39:24.803374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1210/2409] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:24.879327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:24.889939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:24.891840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:24.893330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dafbdb7a-c3d2-409c-93d7-b15779916cd1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.119916 Aug 31 12:39:24.893945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1200/2410] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:25.015670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:25.016301 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:25.023093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:25.023693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:25.024172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:25.025006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:25.025507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:25.025983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:25.185580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:25.194454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5fb01381-cee7-4276-8b44-f353478d18e9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.183594 Aug 31 12:39:25.195052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1211/2411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:25 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:25.631693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:25.632309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:25.638928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:25.639678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:25.640163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:25.640926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:25.641416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:25.641880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:25.836898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:25.837725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:25.846442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:25.847120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:25.847835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:25.848678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:25.849385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:25.849925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:26.131516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:26.141623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b327dd1b-08d0-479f-a551-1fa10bd51335 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.513748 Aug 31 12:39:26.142488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1201/2412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:26.147196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:26.147623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:26.148004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:26.155872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:26.156229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:26.156662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:26.157367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:26.157813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:26.158229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:26.164141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-55676c67-76fa-4af3-8659-e58db103e0dd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.331192 Aug 31 12:39:26.165108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1212/2413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:26.220835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:26.221981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:26.233602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:26.234427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:26.235180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:26.236515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:26.237358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:26.238168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:26.247545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:26.259381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:26.261566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:26.263093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8af53c18-b893-43f1-88dd-84ed4098c8b6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.119592 Aug 31 12:39:26.263870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1202/2414] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:26.418613 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:26.428639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-abf830b2-d455-49ac-ae83-1d647d22db89 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.215580 Aug 31 12:39:26.429234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1213/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:26 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:27.164341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:27.164920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:27.173971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.174477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.174914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.175675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.176268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.176723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.191004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:27.192160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:27.205016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.205887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.206791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.208153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.208999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.209764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.392959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:27.402943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec53b60f-92e9-4aed-ad32-0b3626ad915b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.243315 Aug 31 12:39:27.403587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1203/2416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:27.410509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:27.412358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:27.420424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.421393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.421926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.422741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.423273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.423619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.448015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:27.464108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-56d32d7c-bc77-4220-9c61-5471a458a1f7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.280221 Aug 31 12:39:27.465085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1214/2417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:27.473514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:27.474492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:27.490095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.490095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.490095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.490095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:27.491018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:27.491018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:27.505064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:27.522564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:27.525682 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:27.527972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cfe5b873-ebb2-42b4-83aa-00d70f5e4415 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123024 Aug 31 12:39:27.529010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1204/2418] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:27 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:27.665209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:27.675656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcff13ce-c97f-4df7-bc56-842840af9721 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.208828 Aug 31 12:39:27.676285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1215/2419] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:27 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:28.436347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:28.438050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:28.444803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.445344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.445889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.446739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.447428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.447983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.492420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:28.493337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:28.503346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.503868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.504373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.505124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.505716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.506234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.672610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.683639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2a55d77d-e9fe-43e9-ab4d-4f91d6b828ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.251133 Aug 31 12:39:28.684452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1205/2420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:28 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:28.690206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:28.691121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:28.699166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.699670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.700323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.701027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.701666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.702392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.710210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.721162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-502fbbb3-87b9-4aa7-b730-305a0c714d41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.234593 Aug 31 12:39:28.728417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1216/2421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:28.733631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:28.734996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:28.742766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.743291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.743735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.744440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:28.744966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:28.745387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:28.751150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:28.801877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.813040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.814898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.816238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-924e695e-f7f9-4d49-969c-b91bbbdbdf19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.130758 Aug 31 12:39:28.816894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1206/2422] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:28.927728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:28.937620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dc282715-9912-4256-9090-c183268387a2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.207453 Aug 31 12:39:28.937952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1217/2423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:28 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:29.720369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:29.721187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:29.728622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:29.729266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:29.729744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:29.730526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:29.731023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:29.731744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:29.748101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:29.749178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:29.756546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:29.757035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:29.757522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:29.758239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:29.758689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:29.759116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:29.979562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:29.984430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:29.992780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3f88b41-30a3-4817-bffa-d84d4580b30d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.277390 Aug 31 12:39:29.993767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1207/2424] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:29.996313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:30.002701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:30.003759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:30.012578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f962218-9fff-4ef9-bd24-0b63e89d60d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.268519 Aug 31 12:39:30.013582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1218/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:30.015070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:30.016962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:30.017668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:30.019085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:30.019872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:30.020560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:30.021825 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:30.023138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:30.035344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:30.036606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:30.037319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:30.038610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:30.042933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:30.042933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:30.122065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:30.134146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:30.135955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:30.137376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-35818496-98c2-410b-9cf0-9053ff8a6e40 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.142309 Aug 31 12:39:30.139092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1208/2426] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:30.234655 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:30.245278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c3a6f0d8-c3f0-4dd3-bcc3-2fe34d039b70 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.230279 Aug 31 12:39:30.245933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1219/2427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:30 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:31.019035 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:31.019772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:31.027267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.027909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.028340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.029046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.029494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.029907 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.049981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:31.050866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:31.059608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.060318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.060910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.061866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.062638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.063371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.304264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:31.321698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7278a496-e41f-4307-8a1a-5b28cab46ae4 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.307035 Aug 31 12:39:31.322729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1209/2428] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:31.323751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:31.331941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:31.333054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:31.339845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-312a4b98-076d-40d5-9131-d3c23b81ae35 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.296504 Aug 31 12:39:31.349239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1220/2429] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:31.349527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.349527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.349527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.349527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.350152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.350152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.351819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:31.353098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:31.364643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.365460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.366190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.367501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:31.368374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:31.369150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:31.460212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:31.478170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:31.481350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:31.483582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-32995ac9-adbd-4e6e-bb76-0026f979df95 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.159159 Aug 31 12:39:31.484680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1210/2430] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:31 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:31.588641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:31.606933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a2fb333-2ef9-445c-875e-f620a98de01c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.263300 Aug 31 12:39:31.608044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1221/2431] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:31 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:32.356358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:32.357360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:32.360455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:32.366372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.366866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.367322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.368038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.368489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.368906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.376663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:32.377748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:32.389766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.390918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.392155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.393088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.394042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.394834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.675696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.685662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eb84f568-773c-4277-8b9e-c25e16ae5856 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.333712 Aug 31 12:39:32.686270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1211/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:32 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:32.699031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.699860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:32.700606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:32.712431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb63a4ff-de63-4a06-9da0-d64ced1d39ce tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.343580 Aug 31 12:39:32.712744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.713567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.713976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1222/2433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:32.714310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.715593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.716385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.717138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.732275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:32.733390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:32.744297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.745256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.746065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.747357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:32.748213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:32.749424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:32.811565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.822329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.824256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.825610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15b1cd25-2d2b-4c4a-b183-4d66d07c9f87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.130014 Aug 31 12:39:32.826288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1212/2434] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:32.977641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:32.987744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7a3c5af0-6d05-4e2d-a9f1-1f1773009c9a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.262566 Aug 31 12:39:32.988348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1223/2435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:32 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:33.712037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:33.713041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:33.721150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.721743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.722251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.723049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.723712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.724189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.737276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:33.738028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:33.744746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.745373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.746067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.747210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.747891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.748422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.974461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:33.984234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82538784-3bca-4380-8cf2-df26140f59b9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.251468 Aug 31 12:39:33.985050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1224/2436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:33.989876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:33.990605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:33.996775 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:33.997559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.998095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:33.998493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:33.999213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:33.999690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:34.000391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:34.014590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2beb856c-52f3-45ef-986d-0ca2865290b7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.306597 Aug 31 12:39:34.017351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1213/2437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:34.026861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:34.027982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:34.039357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:34.040057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:34.040839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:34.041999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:34.042806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:34.043619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:34.076321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:34.090532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:34.093475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:34.095357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8a37984-0fc8-4f54-b3a3-a184628f15b1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.109097 Aug 31 12:39:34.096285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1225/2438] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:34.218564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:34.228062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0438f58b-0bab-4c03-bd4e-afd3b143b589 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.208151 Aug 31 12:39:34.228551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1214/2439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:35.019398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:35.020233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:35.022707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=94 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:35.029767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.030254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.030751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.031505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.032244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.032725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.044618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:35.045514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:35.053814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.054763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.055455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.056374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.056900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.057393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.378717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.389008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5525a0b4-6356-427e-beb0-d1a183174e5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.375049 Aug 31 12:39:35.389603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1226/2440] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:35.394771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.397480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:35.398764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:35.408011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.408585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.409234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.410418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.411363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.412023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.414334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-931ffbca-03b1-402a-a31a-7998d4000e65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.373774 Aug 31 12:39:35.415180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1215/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:35.421839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:35.422917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:35.432480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.433374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.434218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.435545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:35.436283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:35.436713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:35.491086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.501205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.502712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.503968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4578bc39-fa35-4b49-8cc2-63e70dadf3f6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113062 Aug 31 12:39:35.504547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1227/2442] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:35 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:35.646474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:35.655783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d5b8014-7fc5-4d68-b1f3-b8d29536c4bc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.239081 Aug 31 12:39:35.656475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1216/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:35 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:36.421059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:36.421744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:36.429285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.429780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.430225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.430946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.431435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.431856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.466114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:36.467435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:36.476455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.477143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.477712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.478592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.479276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.479845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.685064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.695771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25d7cef9-d125-4099-9e59-78fee20b687c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.278671 Aug 31 12:39:36.696645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1228/2444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:36.702684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:36.705034 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:36.721816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.722817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.723515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.724081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.725375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.725961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.726573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.733303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7df96edb-0acd-4a56-8b71-90cc03aa7f0d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.276670 Aug 31 12:39:36.734334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1217/2445] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:36 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:36.740849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:36.741771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:36.749462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.750207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.751009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.752694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:36.753401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:36.754048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:36.851480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.862757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.864300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.865530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58d2ecbd-d94b-42a8-ac6f-97fc55be4591 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.167816 Aug 31 12:39:36.866104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1229/2446] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:36.967478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:36.977306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-51802fcb-55f3-49f6-b827-f1a0baa1d887 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.241381 Aug 31 12:39:36.977952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1218/2447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:36 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:37.727293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:37.728235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:37.738287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:37.739145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:37.739964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:37.741197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:37.742023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:37.742809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:37.768719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:37.769614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:37.777857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:37.778526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:37.779120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:37.780417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:37.781235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:37.781890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.035728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.046659 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ed73e41c-61a5-4c10-b77a-60db4600470e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.323081 Aug 31 12:39:38.047353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1230/2448] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:38.050805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.055432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:38.056433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:38.065127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.066002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.066499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.067283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.067746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.068176 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.071492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dae37799-60b1-4648-bc8f-e8a072456190 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.307452 Aug 31 12:39:38.072149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1219/2449] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:38.090549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:38.091630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:38.102836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.103990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.104753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.106141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:38.107331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:38.108139 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:38.160687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.180097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.182907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.185248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73256f0f-e36b-4dd9-a1fd-686e1e48a407 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.136181 Aug 31 12:39:38.186200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1231/2450] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:38.316363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:38.330701 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-69b977ea-b2fb-4eb6-82c9-e88dea9d4552 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.256391 Aug 31 12:39:38.331343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1220/2451] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:39.068675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:39.069353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:39.076974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.077491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.077907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.078623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.079074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.080085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.098790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:39.099577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:39.106725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.107396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.107835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.108572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.109253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.109704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.346451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:39.348772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:39.357898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e582fb7d-cfd3-4e56-9c25-d0f84c19ecd7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.293479 Aug 31 12:39:39.368050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1232/2452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:39.368302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-18da7262-8037-4fc3-a287-5ce847b855c2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.270473 Aug 31 12:39:39.368413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:39.368413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:39.368589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1221/2453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:39 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:39.374325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.374598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:39.374814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.375265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.375789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:39.375978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.376600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.377979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.386965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.387885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.388664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.390167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:39.391021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:39.392749 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:39.448629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:39.452936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:39.460731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:39.462346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:39.463578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d125bf1-e1eb-4a7a-bdd2-6e454b07c987 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.103703 Aug 31 12:39:39.464144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1233/2454] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:39 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:39.580508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:39.590533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb63e54f-552a-456f-a3de-062dce2ca045 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.223361 Aug 31 12:39:39.591157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1222/2455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:39 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:40.383465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:40.384131 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:40.390938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.391467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.391898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.392764 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.393293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.393875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.406799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:40.407717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:40.416874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.417378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.418007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.418740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.419195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.419656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.641880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:40.648027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:40.657323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1e7609c6-87f7-4fc4-9ce5-e2f44fa03a53 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.278388 Aug 31 12:39:40.658364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1234/2456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:40.664254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57e22bd6-433e-4cb1-a05c-0b762ff6bb65 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.264841 Aug 31 12:39:40.665325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1223/2457] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:40.667479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:40.668924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:40.674976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:40.676080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:40.679774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.680735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.681505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.682712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.683535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.684209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.686663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.687559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.688333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.689586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:40.691989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:40.691989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:40.727785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:40.799956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:40.810692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:40.812233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:40.813504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bdc0d3ac-6a18-4130-aa69-e88610f97bb4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.153494 Aug 31 12:39:40.816513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1235/2458] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:40.947283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:40.957779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-056aea70-5791-4af6-8c31-c10770a39f44 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.290993 Aug 31 12:39:40.958371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1224/2459] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:40 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:41.681583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:41.682548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:41.690925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:41.691619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.691619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:41.692069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:41.692262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:41.693193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.693759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:41.694346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:41.700802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.701452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:41.702019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:41.702872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.703501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:41.704017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:41.934364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:41.946944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1dfc0e1e-92f4-4e4b-8848-758e48be38da tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.269713 Aug 31 12:39:41.948010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1236/2460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:41.957880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:41.961366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:41.967603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:41.975617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.975617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:41.975617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:41.976578 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.977144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:41.977641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:41.982780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d3e5adaa-51a5-40b7-bd72-1071cc6606ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.296344 Aug 31 12:39:41.983593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1225/2461] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:41.989870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:41.990851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:41.998627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:41.999615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:42.000278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:42.001268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:42.002265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:42.002580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:42.084619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:42.096968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:42.100649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:42.102288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-92c55c4e-e9a4-41ab-a6b2-da9efcd3a405 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.152314 Aug 31 12:39:42.103080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1237/2462] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:42.208858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:42.220853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1b6e57d0-28cf-431c-847f-d3b50ad6a472 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.235904 Aug 31 12:39:42.222622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1226/2463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:41 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:42.984558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:42.985219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:42.993100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:42.993595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:42.994029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:42.994751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:42.995202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:42.995666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.024114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:43.025039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:43.032696 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:43.033359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:43.034439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.034974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:43.035615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:43.036117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.240477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:43.252799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c97f3e7f-782a-41f8-ae35-81abdfe788aa tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.272018 Aug 31 12:39:43.259325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1238/2464] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:43.259879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:43.262378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:43.263907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:43.271549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7619bc6-2318-4b39-909f-aece69f79c28 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.251794 Aug 31 12:39:43.272462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1227/2465] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:43 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:43.287429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:43.287429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:43.287429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.287429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:43.288215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:43.288215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.288536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:43.289369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:43.301676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:43.302175 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:43.302647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.303544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:43.304005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:43.304529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:43.363104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:43.373733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:43.375258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:43.376506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e87027d6-4316-444c-af4a-d963b23cc0f1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.121554 Aug 31 12:39:43.377098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1239/2466] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:43.491200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:43.501478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-52db3b7b-9552-4cb5-add0-a6c509f42483 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.221966 Aug 31 12:39:43.502171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1228/2467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:43 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:44.287675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:44.288391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:44.296666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.297204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.297649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.298469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.298957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.300442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.306307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:44.307525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:44.315663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.316288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.316839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.317777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.318424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.319210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.562708 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:44.574935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:44.576987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30b76da0-f6da-46b2-84f0-53debc0eadb4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.294143 Aug 31 12:39:44.589904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1240/2468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:44.589904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:44.589904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:44.590476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b7ec526c-bd5e-44f5-9838-687f6e76c76c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.288396 Aug 31 12:39:44.591328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1229/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:44.598600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.599295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:44.599480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.600104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.600297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:44.601344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.602192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.602888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.610465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.611126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.611739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.612766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:44.613509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:44.614206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:44.708925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:44.727766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:44.730804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:44.733078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-639e611c-c7d7-4c9d-9e72-5ba65b80d460 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.153544 Aug 31 12:39:44.734089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1241/2470] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:44.807218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:44.817635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c79fa0ce-eadb-43ed-9cf6-4acf779e751a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.224916 Aug 31 12:39:44.818316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1230/2471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:44 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:45.616199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:45.617173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:45.620376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:45.621248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:45.626259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:45.627062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:45.628850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:45.629785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:45.630649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:45.631644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:45.631644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:45.631996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:45.631996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:45.632869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:45.633441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:45.633968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:45.970011 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:45.980362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-047017aa-1810-4f31-84af-c41e7d77321e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.364915 Aug 31 12:39:45.981208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1231/2472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:45.990726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:45.992187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:45.992594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:46.003254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-21fd9ee4-5f0f-4213-83a2-eb421546605f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.392697 Aug 31 12:39:46.003623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:46.004449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:46.004678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1242/2473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:46.005716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:46.007003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:46.007797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:46.008331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:46.010551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:46.011377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:46.021066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:46.021712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:46.022413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:46.023407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:46.023935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:46.024423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:46.105818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:46.115756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:46.117203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:46.118391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9778050f-4a4c-435d-a030-96d65894f397 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.135611 Aug 31 12:39:46.118963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1232/2474] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:46.220993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:46.230651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-291eb7aa-e76b-43e7-84cc-b8cc0035f562 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.224725 Aug 31 12:39:46.231363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1243/2475] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:46 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:47.014334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:47.015010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:47.023506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.024122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.024571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.025299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.025901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.026350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.039130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:47.040302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:47.047701 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.048171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.048614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.049325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.049826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.050391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.272163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:47.278014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:47.281349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9bd64e9a-3b08-4a27-b132-b6cd48cf5eeb tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.270958 Aug 31 12:39:47.281953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1233/2476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:47 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:47.287616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:47.288607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:47.295127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6927228-e156-4b31-a59e-51e73811e708 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.260195 Aug 31 12:39:47.296014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.296526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.296962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.297819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.298312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.298818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.302162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1244/2477] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:47.309395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:47.310356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:47.318765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.318765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.319552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.320608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:47.321219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:47.321748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:47.404054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:47.415292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:47.417203 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:47.418428 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5803a077-75d3-4a5b-8626-b8a3cb5fa616 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.135513 Aug 31 12:39:47.419008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1234/2478] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:47 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:47.539799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:47.557110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a954bb9f-24d4-4c14-80d6-54bf86e70d1d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.252560 Aug 31 12:39:47.558120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1245/2479] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:47 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:48.307377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:48.308866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:48.319304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.319959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.320614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.321809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.322528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.323137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.329828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:48.331936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:48.343473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.344722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.345460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.347005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.347847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.348562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.536915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:48.548401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f156650f-5f3d-4b59-ad72-4f7fa3522721 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.247841 Aug 31 12:39:48.549440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1235/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:48.557475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:48.558573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:48.569506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.570351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.571117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.572509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.573334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.574089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.583813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:48.594262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4743077a-a9f5-4152-92a8-f0bddcf0c073 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.268989 Aug 31 12:39:48.595199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1246/2481] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:48.609843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:48.611320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:48.621247 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.621846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.622342 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.623437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:48.624266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:48.625014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:48.656539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:48.671342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:48.672894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:48.674112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e44c7885-92e4-4a85-ad50-ff49962381e1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123390 Aug 31 12:39:48.674975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1236/2482] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:48.825151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:48.841848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-841dcbcf-3d86-4c5b-b057-9e28a04b577d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.240725 Aug 31 12:39:48.842755 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1247/2483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:48 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:49.575439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:49.576536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:49.589488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.590340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.591573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.592992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.593820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.595100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.627004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:49.627871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:49.635060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.635619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.636235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.637415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.637872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.638317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.866487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:49.881843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3ec6ba2f-ccb3-49c6-bbab-905f1813aa89 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.313317 Aug 31 12:39:49.883313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1237/2484] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:49.886153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:49.891954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:49.893461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:49.902089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-863e6c00-1ba3-4b0b-9bbf-e6a40330988d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.278627 Aug 31 12:39:49.903031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1248/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:49.904950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.905808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.906707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.907885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.908698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.909464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.913228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:49.914536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:49.926435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.927864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.928785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:49.930214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:49.931177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:49.932115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:50.021177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:50.038751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:50.041989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:50.044371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83a9257c-67d3-4324-b4aa-3f87b169e6b2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.159288 Aug 31 12:39:50.045461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1238/2486] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:50.156053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:50.171284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a59867b-ed49-45d5-b48d-dfc52fafe5b9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.266221 Aug 31 12:39:50.172278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1249/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:49 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:50.912142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:50.913248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:50.923664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:50.924299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:50.925069 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:50.926687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:50.926936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:50.931047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:50.944503 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:50.945391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:50.953419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:50.953907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:50.954569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:50.955534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:50.955905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:50.956352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:50.992826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:51.415027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:51.424838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9308e7cc-25fc-4d37-9eb3-94f725dfcafa tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.519287 Aug 31 12:39:51.425797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1239/2488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:51.434412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:51.435465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:51.444750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:51.445595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:51.446360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:51.447668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:51.448493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:51.449244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:51.465072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:51.481172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c78116fa-02f7-4782-a8bd-c6a08c0615c3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.543242 Aug 31 12:39:51.482148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1250/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:51.490175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:51.491194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:51.504915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:51.504915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:51.505518 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:51.506509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:51.507134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:51.507962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:51.553581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:51.564557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:51.566258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:51.567695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1fbe400b-613d-40d5-8ea8-6c5ac80ac44e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.140449 Aug 31 12:39:51.568347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1240/2490] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:51.690428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:51.703160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e96c1bd8-f7a4-4a79-998a-428fb19cd8a3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.219345 Aug 31 12:39:51.703903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1251/2491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:51 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:52.455043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:52.455779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:52.463933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.464400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.464831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.465603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.466054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.466476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.471159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:39:52.511381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:52.512279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:52.521290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.521975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.522541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.523610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.524065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.524705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.684551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:52.700160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7ad9cf28-4d32-4441-8267-de59f9184fcc tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.248999 Aug 31 12:39:52.701185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1241/2492] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:52.709390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:52.710165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:52.718054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.718699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.719429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.720339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.720914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.721483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.740536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:52.750334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2837053d-3ea9-432e-92d7-04fa653dac37 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.242848 Aug 31 12:39:52.751199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1252/2493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:52.756940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:52.757564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:52.765024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.765551 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.765990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.766857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:52.767355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:52.767786 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:52.822824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:52.836352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:52.838140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:52.839540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c533864b-cffc-435e-9f6a-d62c9cf0a77a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.136949 Aug 31 12:39:52.840317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1242/2494] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:52 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:52.944734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:52.954416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a1d9ba4a-2eb7-4114-af38-bb5e9b393dc9 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.201991 Aug 31 12:39:52.955013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1253/2495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:52 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:53.734851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:53.735638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:53.744237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:53.744663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:53.745093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:53.745801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:53.746247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:53.746664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:53.773705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:53.775105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:53.784576 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:53.786059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:53.786972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:53.788344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:53.789298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:53.790053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:53.989926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:54.006856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2c0da2f3-faa1-4870-9270-9ff07505d47b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.276071 Aug 31 12:39:54.007964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1243/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:54.017570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:54.018821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:54.030276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:54.031154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:54.031397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:54.031986 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:54.033270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:54.034376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:54.035143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:54.041716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6315186a-0a1c-46b8-a19d-6c4f5308e848 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.272934 Aug 31 12:39:54.042312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1254/2497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:54.047447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:54.048353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:54.058293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:54.059077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:54.060007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:54.061212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:54.062227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:54.063146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:54.141929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:54.152647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:54.154253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:54.155735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f58543f2-69c3-4114-957e-72e6c906787d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.146398 Aug 31 12:39:54.156313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1244/2498] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:54.259380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:54.269107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c567749b-ef70-42e9-96fe-18d9bfc9d69a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.225684 Aug 31 12:39:54.270166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1255/2499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:54 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:55.047270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:55.048207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:55.059465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.060331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.060957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.062102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.062934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.063735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.072989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:55.073689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:55.080985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.081487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.081896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.082721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.083545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.083942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.330055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:55.335901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:55.342666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04adefe2-5623-435e-8a5d-c5b78441167c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.273423 Aug 31 12:39:55.343579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1256/2500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:55.350710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:55.351874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:55.353572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83a8e944-f5b6-4f2e-95c2-f50eb0b66c56 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.309911 Aug 31 12:39:55.355299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1245/2501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:55 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:55.365942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.367154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.368037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.368555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:55.369240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.369854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.370386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:55.370595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.381975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.382743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.383311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.384166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:55.384718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:55.385333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:55.494772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:55.511506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:55.514145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:55.516398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb44f940-f171-4683-8a19-d4feb2c7ee35 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.170938 Aug 31 12:39:55.517382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1257/2502] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:55 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:55.589699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:55.599819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3ada0dbe-9ddc-4162-8040-aeb25e45be03 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.242906 Aug 31 12:39:55.600599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1246/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:55 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:56.376171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:56.376937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:56.385583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.386237 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.386794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.387676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.388236 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.388756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.390171 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:56.391331 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:56.400410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.401190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.401860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.402992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.403818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.404353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.708029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:56.713799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:56.718070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34afb243-abcb-4058-bd26-c199981d010a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.346524 Aug 31 12:39:56.718654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1258/2504] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:56.729325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:56.729984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9cdc1567-e66a-4240-9264-1dd2ec13ff18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.344054 Aug 31 12:39:56.730127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:56.730962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1247/2505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:56.739626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.739979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:56.740286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.740930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:56.741136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.741670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.742137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.742564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.752487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.753349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.754090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.755667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:56.756470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:56.757200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:56.837869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:56.848245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:56.850942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:56.852209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2fc46267-55e6-4402-9b86-04ff63252f29 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.132609 Aug 31 12:39:56.852783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1259/2506] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:56.948150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:56.957781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-190f9601-5190-48ba-9e3f-a5d690f72b5c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.225025 Aug 31 12:39:56.958299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1248/2507] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:56 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:57.742422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:57.743111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:57.750778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:57.751387 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:57.751966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:57.752711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:57.753170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:57.753601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:57.760128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:57.761052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:57.768979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:57.769694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:57.770342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:57.771535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:57.772240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:57.772876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:57.986870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:57.999306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2d88aea2-cafa-4a63-af36-47048731ee27 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.260555 Aug 31 12:39:57.999813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1260/2508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:58.009816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:58.015811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:58.017067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:58.022768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b7114c6-38d4-4121-9e54-fae626db05ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.268139 Aug 31 12:39:58.023747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1249/2509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:58.028490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:58.028800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:58.029112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:58.029442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:58.030027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:58.031032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:58.031754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:58.032336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:58.035632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:58.036117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:58.036637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:58.039275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:58.039275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:58.039275 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:58.121334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:58.138664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:58.141753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:58.144136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-da441dcf-b879-480f-b35e-b395bc42016c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.142790 Aug 31 12:39:58.145161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1261/2510] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:58.233663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:58.242785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-58042a83-bd2c-4408-8c9a-42993b81970d tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.217926 Aug 31 12:39:58.243420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1250/2511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:58 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:59.034581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:59.035715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:59.044376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.045001 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.045487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.046254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.046766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.047476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.065719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:59.066832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:59.078103 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.078920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.079704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.080923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.081741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.082451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.298637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:59.310310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cbdf2601-7cb3-4286-b444-b7b2138b7026 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.279719 Aug 31 12:39:59.311645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1262/2512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:39:59.320261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:59.322215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:59.332899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.334872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.335724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.337027 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.337520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:59.337876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.338402 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.350259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4f4e63ba-4563-40d0-820e-51848db31218 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291569 Aug 31 12:39:59.350761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1251/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:39:59.356268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:39:59.356896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:39:59.364028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.364514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.365236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.366244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:39:59.366679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:39:59.367101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:39:59.465829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:59.476366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:59.477889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:59.479075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1e86aab3-dfda-4208-8cf5-ded72adbc769 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.166421 Aug 31 12:39:59.479720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1263/2514] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:39:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:39:59.611834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:39:59.625466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d7b7f700-6164-4791-968f-72a00257b9db tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.273358 Aug 31 12:39:59.626076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1252/2515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:39:59 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:00.346401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:00.347308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:00.355045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.355671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.356117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.356931 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.357427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.357849 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.514088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:00.514790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:00.521813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.522406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.522911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.523753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.524236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.524664 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.538513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:00.548636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e8f2296e-e42a-4d5d-b93c-46e4db1611d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.206074 Aug 31 12:40:00.549569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1264/2516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:00.554911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:00.555635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:00.567445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.568494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.569456 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.570834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.571506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.571947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.653808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:00.663520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:00.665008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:00.666350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f72c910-0e15-472f-9977-88f8fffcb97e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.115671 Aug 31 12:40:00.667049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1265/2517] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:00.672778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:00.673682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:00.681348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.681926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.682431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.683355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:00.683827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:00.684339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:00.712300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:00.721387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-570b3787-ccac-4fa6-9512-0ad58e17e31d tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.342372 Aug 31 12:40:00.721994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1253/2518] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:00.903169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:00.913802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ec7c3563-0103-4e4c-a509-ea0a989c5801 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.245437 Aug 31 12:40:00.914403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1266/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:00 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:01.571504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:01.572284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:01.574748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:40:01.575058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda (ip 10.222.0.27) !!! Aug 31 12:40:01.582857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.583378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.583930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.584942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.585602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.586039 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.698079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:01.699323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:01.704312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:40:01.704312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:40:01.718911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.719816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.720592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.721878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.722693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.723508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.736516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:01.807052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:01.816585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b1d4162-97cc-4087-8bf9-5554521dbecc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.249434 Aug 31 12:40:01.817274 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1254/2520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:01.822437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:01.822927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:01.832970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.832970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.832970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.833960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.834951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.835725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.840507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:01.857020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:01.859085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:01.860630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0b35fe0-bab1-4cac-9ed1-57c13e5d3eb0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.169707 Aug 31 12:40:01.861443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1267/2521] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:01.940355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:01.941485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:01.952821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.953649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.954348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:01.955616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:01.956407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:01.957153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:02.002122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:02.019362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-af1307d5-eb84-4b40-8705-b1b3cf3f8338 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.200615 Aug 31 12:40:02.020424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1255/2522] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:02.144089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:02.158936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8119f46e-b3ca-4486-86cc-6264796f50d6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.225333 Aug 31 12:40:02.159975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1268/2523] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:01 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:02.844051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:02.844963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:02.847539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=90 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:02.854641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:02.855180 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:02.855718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:02.856633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:02.857290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:02.857815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:02.902410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:02.906364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:02.918649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:02.919525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:02.920269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:02.921944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:02.923140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:02.930809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:03.031184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:03.044331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:03.046297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:03.047830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-08a396b0-7cae-4438-a5c4-7f72093cc895 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.152730 Aug 31 12:40:03.048922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1269/2524] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:02 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:40:03.058972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:03.060170 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:03.070099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:03.070665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:03.070933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:03.071399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:03.072349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:03.073059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:03.073869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:03.083020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7282f70c-d266-4905-b460-c76bf28e8d73 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.243341 Aug 31 12:40:03.083833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1256/2525] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:03.183573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:03.184280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:03.195461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:03.196479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:03.197248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:03.198493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:03.199344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:03.200073 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:03.248896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:03.259129 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fbd0ac35-0c23-4b56-9ff2-657b0286ba35 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.207959 Aug 31 12:40:03.259769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1270/2526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:03.394047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:03.397729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:03.403483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4e0ebc9f-2ad2-472d-8881-904689e78e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.224845 Aug 31 12:40:03.404104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1257/2527] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:03 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:04.079721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:04.080393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:04.088296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.088913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.089485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.090292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.090883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.091639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.108323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:04.109266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:04.117340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.117905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.118469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.119280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.119889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.120523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.191625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.204876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.207259 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.208964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea7c158d-47e1-4cc3-8c15-b9938293f842 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.133118 Aug 31 12:40:04.210358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1271/2528] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:04 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:04.282608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:04.283260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:04.290374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.290866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.291401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.292053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.292509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.292935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.335973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.353239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5fbad775-ca2e-44bd-9b72-982f97345588 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.249135 Aug 31 12:40:04.354248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1258/2529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:04.429665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:04.431197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:04.442751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.443732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.444520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.445800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:04.446945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:04.447921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:04.465378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.474391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34d46e25-d30d-458f-a8eb-07505d2d4adf tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.196354 Aug 31 12:40:04.475775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1272/2530] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:04 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:04.638473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:04.648084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-154f9a49-32c7-4f29-bd01-f98120172d1b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.225994 Aug 31 12:40:04.648628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1259/2531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:04 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:05.248686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:05.249707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:05.252277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=94 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:05.260527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.261296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.261828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.262774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.263453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.264178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.345349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.360575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.363597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.365992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c02d010-15e0-453d-ba43-174d2b5e8949 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.121677 Aug 31 12:40:05.367900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1273/2532] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:05 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:05.389287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:05.390204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:05.397566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.398272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.398712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.399493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.399953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.400425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.506508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:05.507776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:05.516864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.517679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.518225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.519120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.519744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.520235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.573681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.584842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eaba5c54-9ac7-4329-8b75-2ef013165d6d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.199321 Aug 31 12:40:05.586251 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1260/2533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:05.672023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:05.672885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:05.681148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.681948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.682621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.683643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:05.684337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:05.684977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:05.711169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.722205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d1b19764-4f56-475f-bbdf-ffde52fd5dcd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.220555 Aug 31 12:40:05.722991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1274/2534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:05 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:05.854454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:05.864211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1069bec9-ec79-4e34-8511-df2eb2bfad79 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.197003 Aug 31 12:40:05.864848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1261/2535] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:05 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:06.405078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:06.405828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:06.414101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.414643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.415113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.415907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.416461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.416926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.505160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:06.519840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:06.521409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:06.523638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cb65a2f4-5bcc-49dd-b7b9-5cbcb7278fb1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.123032 Aug 31 12:40:06.524249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1275/2536] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:06 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:06.622327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:06.623020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:06.631066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.631768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.632934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.633774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.634239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.634666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.748205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:06.749009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:06.760531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.761347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.762104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.763359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.764158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.764887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.857258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:06.867853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d16caeec-c3da-4429-bdbe-ed553fbd6e87 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.250117 Aug 31 12:40:06.868444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1262/2537] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:06.897810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:06.898703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:06.910346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.911220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.912038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:06.913358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:06.914164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:06.914917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:07.010085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:07.020416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c852cfa-752b-4646-b364-9539667b1d75 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.277818 Aug 31 12:40:07.021033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1276/2538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:06 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:07.124343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:07.135527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7bc97e50-04c5-42fa-a893-b30c3c652b9e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.245570 Aug 31 12:40:07.136539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1263/2539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:06 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:07.548887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:07.549933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:07.557368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:07.557874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:07.558298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:07.559047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:07.559541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:07.559967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:07.638509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:07.656114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:07.659067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:07.661180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4fe2b13-9692-4281-b152-e2c6a5a494dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.116698 Aug 31 12:40:07.662195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1277/2540] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:07 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:07.890246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:07.890899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:07.899776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:07.900278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:07.900784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:07.901523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:07.902263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:07.902852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.059850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:08.060732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:08.070374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.071032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.071507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.072260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.072728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.073158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.092249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.105822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fcd00463-0bff-4e88-b578-ebe45b7cb4d8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.219843 Aug 31 12:40:08.119267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1264/2541] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:08.160256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:08.160845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:08.171616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.172683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.173214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.174023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.174567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.175123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.308367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.319305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cdaf62a9-49b9-41ac-9f6a-ff39033ca8e6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.263834 Aug 31 12:40:08.320487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1278/2542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:08 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:08.381286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.390811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca992d39-e2d1-48ea-aa8c-60c5d2b3e959 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.235770 Aug 31 12:40:08.391445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1265/2543] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:08 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:08.685037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:08.685683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:08.693110 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.693601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.694030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.695218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:08.695496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:08.696059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:08.779650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.790772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.792320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:08.793565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0db5a2d2-59a1-4d3f-a4c0-d3f0d960e314 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.112717 Aug 31 12:40:08.794300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1279/2544] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:08 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:09.138663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:09.139395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:09.146734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.147285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.147977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.148807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.149389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.149833 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.309512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:09.324921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b654431e-9b9c-485b-93d2-a5914f975cb1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.190020 Aug 31 12:40:09.325939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1266/2545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:09 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:09.355306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:09.356439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:09.365187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.365775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.366327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.367406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.367773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.368252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.426728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:09.427358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:09.435028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.435674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.436208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.437099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.437622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.438360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.586547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:09.602012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1a5590d-a69c-4b9e-bf13-01d1e477be00 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.262158 Aug 31 12:40:09.603393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1280/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:09 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:09.643486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:09.655555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-340d6d8c-872f-47db-b97c-fcb8dd3e4b90 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.233501 Aug 31 12:40:09.656410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1267/2547] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:09 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:09.818452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:09.819282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:09.827975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.828470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.828911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.829642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:09.830098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:09.830522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:09.911629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:09.922822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:09.924703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:09.926231 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-531b1ff3-7b81-4b55-9851-27ee90950d87 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.112030 Aug 31 12:40:09.926797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1281/2548] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:09 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:10.348897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:10.349579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:10.357211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.357869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.358529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.359481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.359977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.360434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.545049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:10.562353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6efcb295-8e78-463e-bc02-81865b445cdf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.217827 Aug 31 12:40:10.563445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1268/2549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:10.628481 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:10.629061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:10.637218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.637872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.638492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.639484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.640053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.640596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.683409 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:10.684964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:10.707448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.708228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.709025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.710413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.711603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.712344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.943863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:10.954070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc03be58-cf84-4ce4-bef1-d39ff72fdccd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.329728 Aug 31 12:40:10.954730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1282/2550] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:10 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:10.967465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:10.968751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:10.978501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.979059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.979832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.980532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:10.981006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:10.981425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:10.998281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:11.010325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e4d7c485-e9fc-473f-90a0-42fa97c598fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.333967 Aug 31 12:40:11.011123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1269/2551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:10 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:11.058429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:11.061995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:11.070584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:11.072199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:11.073441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e25246de-33d3-409b-b473-ebe633e0325e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.112273 Aug 31 12:40:11.074151 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1283/2552] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:10 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:40:11.584773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:11.585640 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:11.595459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:11.596024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:11.596619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:11.597407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:11.597999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:11.598584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:11.756375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:11.767494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7f241776-a8a9-4b36-836d-6096bf493e47 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.186830 Aug 31 12:40:11.768193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1270/2553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:11.977071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:11.977999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:11.986012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:11.986583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:11.987045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:11.988108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:11.988694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:11.989218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.035917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:12.037145 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:12.050303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.051186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.052380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.054072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.055802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.056691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.230437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.240321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e834167d-ae38-442b-9766-99716e668f26 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.267533 Aug 31 12:40:12.241324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1284/2554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:11 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:12.246453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:12.247217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:12.254168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.254660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.255090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.255852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.256303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.256720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.284459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.294932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a942b803-779c-4d38-ab60-bbb3c6346b06 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.264517 Aug 31 12:40:12.295957 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1271/2555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:12 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:12.331880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.343041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.344656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.346086 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de331437-ebbb-45f4-a065-32e5e9d27d9c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.104142 Aug 31 12:40:12.346779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1285/2556] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:12 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:12.792439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:12.793098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:12.800844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.801342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.801809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.802516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:12.802979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:12.803434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:12.958204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:12.968074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77860e04-ac6c-4af4-abee-ed1b1d0f82ac tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.181615 Aug 31 12:40:12.968827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1272/2557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:13.276901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:13.277928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:13.287882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.288369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.288872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.289516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.289992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.290444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.330706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:13.331448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:13.339298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.339891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.340602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.341506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.342355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.343134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.530908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:13.542806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4c9143f4-3c69-4146-80a8-1e060e5da372 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.273428 Aug 31 12:40:13.543446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1286/2558] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:13 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:13.548781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:13.549505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:13.561986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.562878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.563746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.565037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.565877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:13.566806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:13.567047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:13.576599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-036da046-1b62-44a3-9b31-e2c1f95b79ef tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.251919 Aug 31 12:40:13.577200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1273/2559] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:13 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:13.644478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:13.654675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:13.656230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:13.658106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d034ad36-f355-4b65-8a72-4780e798e324 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.113150 Aug 31 12:40:13.659147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1287/2560] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:13 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:13.990789 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:13.991614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:13.999082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:13.999840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.000313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.001087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.001651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.002148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.026199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:14.167272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.182787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78860651-c2d2-4e5d-86e2-660f897bdd6e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.195974 Aug 31 12:40:14.183884 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1274/2561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:14.576505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:14.577273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:14.585032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.585529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.586375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.589830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.590446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.590940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.611154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:14.611977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:14.619752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.620502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.620722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.621424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.622031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.622455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.845187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.855552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6e72ef7-658d-46a8-93f6-eec219fc0eb3 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.283202 Aug 31 12:40:14.856152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1288/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:14 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:14.862874 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:14.863538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:14.868118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.871175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.871996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.872424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.873338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:14.873802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:14.874215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:14.891270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80590363-2a34-4321-88b9-a086522a76f8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.284414 Aug 31 12:40:14.896786 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1275/2563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:14 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:14.963876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.974124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.975982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:14.977987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea4e32b8-441b-4cb7-a86d-be76639102ee tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.120828 Aug 31 12:40:14.978575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1289/2564] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:14 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:15.218137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:15.218937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:15.226505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.227102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.227583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.228386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.228849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.229278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.389824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:15.399964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-325b02ad-f75c-4df9-9395-5f37bbbf0ce4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.185246 Aug 31 12:40:15.400572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1276/2565] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:15.889801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:15.890595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:15.899302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.900015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.900462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.901192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.901642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.902063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.926397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:15.927437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:15.935085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.935690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.936382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:15.937246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:15.937862 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:15.938531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.165817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.175960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70791d82-445f-4841-b365-5ab03059573c tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.290130 Aug 31 12:40:16.176830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1290/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:15 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:16.177083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.183020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:16.184044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:16.193029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:16.193799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:16.194445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.195530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:16.196265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:16.197191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.197482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-918bda4b-9cde-4ff2-bdd9-384a4639ad67 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.275912 Aug 31 12:40:16.203381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1277/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:15 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:16.274347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.288843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.291667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.293855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f3143735-a435-44d7-8bd8-42140e771963 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.115392 Aug 31 12:40:16.294901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1291/2568] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:16 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:16.424220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:16.424834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:16.433507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:16.434292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:16.434971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.435790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:16.436453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:16.436922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:16.615071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:16.624887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d6e14413-3792-4b14-8605-e2d5f07236c9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.205286 Aug 31 12:40:16.625743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1278/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:17.211139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.211839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.221336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.222101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.222790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.223952 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.224703 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.225272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.225513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.226237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.236187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.236967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.237657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.238838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.239604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.240293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.478709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.483600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.494449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6e4444c9-29e9-4d46-a9c6-8a01360af40a tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.275529 Aug 31 12:40:17.495298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bc45be16-fff3-41cb-af8d-ef3dee636cb1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.288241 Aug 31 12:40:17.495506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1279/2570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:17.496902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1292/2571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:17.504799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.505901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.517440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.518593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.519395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.520660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.521503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.522244 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.622183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.633470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.635839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.637271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d043940a-47b6-4d0d-a24b-c71c569f1c2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.140358 Aug 31 12:40:17.637947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1280/2572] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:17.652644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:17.653815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:17.665234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.665770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.666262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.667126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:17.667672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:17.668136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:17.825331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:17.835403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4cc978f8-1657-4b94-b557-19d0333aa4e0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.190696 Aug 31 12:40:17.836052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1293/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:18.521484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:18.522603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:18.523302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:18.523500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:18.531068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.531734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.532009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.532363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.532687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.533136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.533486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.533916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.534107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.534501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.534754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.534999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.852901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:18.859580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:18.864627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-56bcd59d-5ec4-4345-8d78-78e9cbed1936 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.347467 Aug 31 12:40:18.865338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1281/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:18 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:18.873093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:18.874135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:18.876759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d21ca47b-4c33-4fc5-86f9-7c290ead9b21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.358864 Aug 31 12:40:18.878214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1294/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:18 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:18.888365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:18.891397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:18.897167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.898379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.899496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.901052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.902946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.903365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.903731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.904420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.905031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:18.905879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:18.906686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:18.907431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:19.024767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:19.037201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:19.038782 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:19.041366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe5c9074-feb7-475d-a1c5-b3e896983151 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.174479 Aug 31 12:40:19.042990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1282/2576] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:18 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:19.146535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:19.161261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5d65d4e4-b6e5-4ffa-9003-31c47ebb80cd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.281778 Aug 31 12:40:19.162020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1295/2577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:19.892948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:19.893956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:19.903167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:19.903798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:19.904359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:19.905184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:19.905781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:19.906343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:19.917594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:19.918710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:19.928976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:19.929720 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:19.930537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:19.937105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:19.937864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:19.938612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:20.187387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:20.198238 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3f25dbb-9c53-48a2-bb03-3581ac77f031 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.309893 Aug 31 12:40:20.199044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1283/2578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:19 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:20.207192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:20.208071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:20.209204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:20.220731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:20.221632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:20.221966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9da6640f-55ca-4669-b5ca-35e91c64b4f3 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.310187 Aug 31 12:40:20.222383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:20.226315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1296/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:19 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:20.226630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:20.226630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:20.226630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:20.237044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:20.240136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:20.255904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:20.256997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:20.257900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:20.259861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:20.260362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:20.261154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:20.329852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:20.349977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:20.352033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:20.354562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b57b9483-ea66-4fbb-87d4-003b0d272771 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.153948 Aug 31 12:40:20.355260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1284/2580] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:20 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:20.473152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:20.483862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-113e43b0-d88e-463a-88c3-1945b258b0a9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.258929 Aug 31 12:40:20.484653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1297/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:21.234532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:21.235591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:21.245237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.245237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.245713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.246391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.246867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.247342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.263936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:21.266249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:21.279159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.280324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.281390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.282547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.283403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.284118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.528858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:21.536095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:21.541996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0060c4e5-e5cd-4cc4-b803-be05e63f2bd8 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.311299 Aug 31 12:40:21.542772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1285/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:21 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:21.549672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:21.550708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:21.558783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f743dcaf-5c58-4942-88cd-f955905d9246 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.302906 Aug 31 12:40:21.560799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1298/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:21 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:21.565978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.567007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.567777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:21.568107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.569232 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:21.569460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.570315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.571761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.578741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.579297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.579745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.580582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:21.580935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:21.581348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:21.682001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:21.699286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:21.702424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:21.704673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-caca45b7-0466-4a73-9990-ba46a5f2c4dc tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.160181 Aug 31 12:40:21.706242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1286/2584] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:21 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:21.832662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:21.845878 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2760083b-bba1-422d-91f3-d8a8afe5a954 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.283422 Aug 31 12:40:21.846534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1299/2585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:22.583479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:22.584133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:22.594713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.595560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.596298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.597480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.598207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.598894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.604984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:22.606193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:22.618226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.619835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.620538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.621796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.622595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.623377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.658625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:22.862692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:22.880441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb09d402-7bbb-482e-b15b-443057b9494a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.301343 Aug 31 12:40:22.881474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1287/2586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:22 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:22.889626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:22.890546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:22.902333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.902333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.902691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.903525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.903960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.904459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.910224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:22.926087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de8955aa-0776-4a09-b755-5658908d37fd tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.329618 Aug 31 12:40:22.927095 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1300/2587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:22 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:22.935133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:22.936406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:22.947077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.947958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.948697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:22.949922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:22.950694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:22.951448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:23.004529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:23.019576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:23.022909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:23.025338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa13718d-bc37-451c-9e51-23285f5f4d0d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.141940 Aug 31 12:40:23.025970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1288/2588] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:22 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:23.191557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:23.203263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b0a1c4e4-afd2-483f-8481-d8012322ec99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.274674 Aug 31 12:40:23.204056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1301/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:23.918713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:23.919551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:23.930685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:23.931453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:23.932276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:23.933614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:23.934313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:23.935018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:23.964654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:23.966069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:23.978393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:23.979263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:23.981946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:23.983214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:23.983868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:23.984685 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.286185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.299821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0aba3742-7522-48ef-8712-d5b259e82487 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.387840 Aug 31 12:40:24.300488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1289/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:23 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:24.307784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:24.308450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:24.312562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.317183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:24.317183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:24.317641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.318156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:24.318687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:24.319297 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.332199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c37ad6e-e47c-43c5-9069-316f11bd10c1 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.376446 Aug 31 12:40:24.342707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1302/2591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:23 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:24.342707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:24.342707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:24.354160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:24.354898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:24.355192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.356212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:24.356783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:24.357375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:24.731694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.748494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.750704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.752911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a4eee07-709a-4bf2-839e-a9e851c9e8c0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.451080 Aug 31 12:40:24.754411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1290/2592] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:24 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:24.903690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:24.919072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-479f1ca0-4926-4222-ad19-298b385f421c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.584537 Aug 31 12:40:24.920486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1303/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:25.333572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.334410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.342360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.342860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.343328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.344055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.344514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.344942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.349960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:25.393189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.394433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.405640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.406513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.407289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.408496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.409304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.410049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.597024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:25.609770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c674987f-cfeb-4cdf-837d-4d764a1946f6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.280549 Aug 31 12:40:25.610380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1291/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:25 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:25.652468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:25.666050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8843df09-eea5-475a-a0d7-916b2109c394 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.281111 Aug 31 12:40:25.667073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1304/2595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:25 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:25.785980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.786932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.796009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.796501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.797051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.797829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.798663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.799142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.902466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:25.917454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:25.919015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:25.920341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2755aee-ca02-44df-bf47-cf1a50e4ca30 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.139442 Aug 31 12:40:25.920965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1292/2596] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:25 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:25.954431 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:25.955201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:25.962370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.964217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.964716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:25.965454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:25.965943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:25.966493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.170572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:26.180088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f7fca7a2-7440-444c-bf05-caae314ee8e6 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.229695 Aug 31 12:40:26.180732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1305/2597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:26.638732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:26.639857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:26.651915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.652748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.653469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.654725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.655614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.656369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.694760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:26.696377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:26.710733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.711679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.712767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.714611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.715424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.716964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.906500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:26.923366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cf3e98b2-08ad-4ae6-bbda-4179b895eb18 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291041 Aug 31 12:40:26.924439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1293/2598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:26 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:26.957066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:26.960453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:26.961088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:26.967471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a7d6fefb-dc0d-49ae-9ade-e3f6734510af tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.279740 Aug 31 12:40:26.968073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1306/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:26 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:26.969982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.970529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.970973 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:26.971728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:26.972184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:26.972743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.058383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:27.071306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:27.073439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:27.074997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-799ac5c0-760c-4950-be41-1d2d209882e2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.119237 Aug 31 12:40:27.075921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1294/2600] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:26 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:27.204657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:27.205336 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:27.213325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.214794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.215348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.216243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.216732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.217300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.397113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:27.408204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2bbf9aca-4359-4055-80b3-a80b24768d48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.207911 Aug 31 12:40:27.408889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1307/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:27.964929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:27.965924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:27.974910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.975506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.975982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:27.977132 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:27.977712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:27.978249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.003934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:28.004850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:28.013807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.014522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.015057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.015993 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.016614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.017221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.230797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.246310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-63db3cd5-4693-4ae0-ac65-8eabe3611816 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.287984 Aug 31 12:40:28.247361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1295/2602] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:27 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:28.256483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:28.257767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:28.267030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.273905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.274399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.274908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.275780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.276483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.277080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.282331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2afe90f-2a38-4f2b-926a-2aece231e346 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.283391 Aug 31 12:40:28.283349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1308/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:27 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:28.358042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.369598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.371658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.372829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6ed0b164-9303-45df-b358-ddc46fa179bb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.124131 Aug 31 12:40:28.373416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1296/2604] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:28 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:28.435570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:28.436035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:28.443859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.444355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.444763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.445485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:28.445937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:28.446369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:28.650437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:28.662424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa14d92e-7fdd-47b9-a82e-5c9d8458f27c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.232511 Aug 31 12:40:28.663130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1309/2605] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:28 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:29.283728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:29.284726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:29.293805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.294296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.294735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.295504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.296018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.296502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.316570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:29.317388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:29.327971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.329415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.330470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.331822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.332646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.333600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.589357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.599508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.603583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-281c5778-cf6d-4734-85b2-5da717905703 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.323739 Aug 31 12:40:29.604806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1297/2606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:29 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:29.611373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:29.612324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:29.616863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a80e2aaf-4fb6-43e5-a665-d6bf625dc8f7 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.304313 Aug 31 12:40:29.618155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1310/2607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:29 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:29.622438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.622940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.623426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.624158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.624616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.625051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.692449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:29.694505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:29.705672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.706763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.707377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.708265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:29.708897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:29.709464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:29.720224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.737183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.740359 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.742548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd638e49-5a8c-4f19-8e1f-6ac254f851e6 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.136121 Aug 31 12:40:29.743662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1298/2608] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:29 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:29.922270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:29.932442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d6964f67-2dfe-4822-8fc9-7b2f07617a77 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.249009 Aug 31 12:40:29.933061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1311/2609] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:30.628389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:30.629042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:30.637465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.637982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.638401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.639458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.640170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.640788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.641008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:30.641770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:30.649216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.649718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.650197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.651047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.651406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.651889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.913197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:30.917972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:30.929042 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-51f35e95-b5df-4a69-9a07-a344f997a08e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.304504 Aug 31 12:40:30.930260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1299/2610] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:30 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:30.932667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-459fd101-15ac-4199-ab67-da12b23ed0d8 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.295433 Aug 31 12:40:30.934451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1312/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:30 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:30.941552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:30.942965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:30.955767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.956798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.957647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.958784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:30.958955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.959922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.960614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:30.960878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.968192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.968736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.969251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:30.970134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:30.970666 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:30.971202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:31.095090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:31.112584 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:31.115748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:31.117861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe65c8a8-085c-4e7d-9dbb-4bbc223afe19 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.186147 Aug 31 12:40:31.123812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1300/2612] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:30 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:31.203436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:31.213563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a270a7b-e715-499b-813c-16efa5c694fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.260486 Aug 31 12:40:31.214429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1313/2613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:31.971067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:31.972147 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:31.975171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:31.976533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:31.981589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:31.982233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:31.982919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:31.984242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:31.984974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:31.985508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:31.986593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:31.987148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:31.987721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:31.988796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:31.989403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:31.989904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.243269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:32.254349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:32.257943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d84ecea4-ac89-4622-a160-b09b30e74ee0 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.288773 Aug 31 12:40:32.258930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1314/2614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:31 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:32.266692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:32.267711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:32.271512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9ee7115-a829-450c-a8e3-cf96c7cf327e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.305876 Aug 31 12:40:32.280334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1301/2615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:31 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:32.281635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:32.282774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:32.285008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:32.286220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:32.287620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.289309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:32.290195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:32.291066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.293595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:32.294343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:32.294988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.297382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:32.297382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:32.297382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:32.412782 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:32.430895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:32.434278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:32.436541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3aeddb55-2f35-4ead-9b6b-68b9db1a60f0 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.175933 Aug 31 12:40:32.437562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1315/2616] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:32 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:32.495734 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:32.505534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa5f2cf3-3687-49b4-926d-848f0e0ec0d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.231277 Aug 31 12:40:32.506376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1302/2617] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:33.299566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:33.300820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:33.310992 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:33.312198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:33.313214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.314050 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.314822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.315577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=94 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:33.316112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.317244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.318217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.323019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.323755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.324506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.328017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.328017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.328017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.606775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:33.613470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:33.619173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30ed77e2-1066-4705-bede-1174b43948ef tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.327107 Aug 31 12:40:33.620045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1316/2618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:33 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:33.625166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-00604a2d-dda3-48f4-9791-892043f67760 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.322377 Aug 31 12:40:33.626223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1303/2619] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:33 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:33.631928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:33.632704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:33.636088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:33.636885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:33.641048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.641604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.642229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.643206 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.643700 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.644243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.656162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.656974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.657731 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.659007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:33.659839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:33.660679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:33.669375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:33.786498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:33.803729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:33.806882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:33.809137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a8661b12-15de-4235-8d1a-af08b4b9121b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.187151 Aug 31 12:40:33.810115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1317/2620] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:33 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:33.896396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:33.909235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c3e12c3e-2da5-40c6-b1e3-39f9599db7c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.281351 Aug 31 12:40:33.910019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1304/2621] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:34.655897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.656803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.657004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.657736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.666364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.666990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.667422 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.667743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.668535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.668936 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.669144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.669788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.669987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.670455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.670680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.671083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.940347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:34.947145 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:34.954466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8bcbbc22-d437-4d45-804e-1061a6ee6c88 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.301878 Aug 31 12:40:34.955333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1305/2622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:34 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:34.963226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d99c2515-5f81-4d13-bda3-5ca33e52e964 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.311385 Aug 31 12:40:34.965742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.967092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.975513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1318/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:34 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:34.987491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:34.988524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:34.988772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.989712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.990410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.991643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.992395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:34.993264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:34.998595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:34.999350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:35.000005 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:35.001108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:35.001800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:35.002446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:35.158080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:35.169955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:35.171715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:35.173005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d3db8e7-18c4-45d2-83bb-3fc74bf87873 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.216313 Aug 31 12:40:35.173706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1306/2624] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:34 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:35.274297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:35.284996 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f2bd572-c504-41f1-91c6-0b9b61090fd3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.307735 Aug 31 12:40:35.285441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1319/2625] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:35.991208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:35.992524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:36.000338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.000971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.001787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.001994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:36.002627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.002627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.002963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:36.003131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.007563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=94 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:36.016193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.017042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.017767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.018908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.019555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.020368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.272541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:36.284582 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:36.285929 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae01741d-1940-439c-8c51-26e220e792f1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.291504 Aug 31 12:40:36.286634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1320/2626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:35 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:36.291840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:36.294251 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:36.295144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:36.303852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.304335 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e81a9d5b-790d-4ec0-b536-d90aeb01eebc tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.317558 Aug 31 12:40:36.304637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.305505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1307/2627] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:35 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:36.305774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.306726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.307374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.307920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.325016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:36.326125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:36.335019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.335818 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.336535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.337527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:36.338168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:36.338719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:36.408171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:36.422690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:36.424322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:36.425653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fa1d6f9-c681-40ad-8b29-3acce31895da tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.137769 Aug 31 12:40:36.426404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1321/2628] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:36 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:36.565189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:36.575965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b0c61db-141a-4b8d-9ea5-bf4071865e99 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.258045 Aug 31 12:40:36.576607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1308/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:37.317761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:37.318639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:37.326780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.327319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.327766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.328602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.329090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.329676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.345212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:37.346498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:37.358468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.359320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.360046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.361233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.362029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.362978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.627159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:37.641383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76b725ee-b461-4100-9cac-c17cb72faca7 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.327622 Aug 31 12:40:37.643304 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1322/2630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:37 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:37.654852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:37.666684 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:37.668316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:37.672662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f783ea21-491b-49bf-b554-33995b681a3b tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.334643 Aug 31 12:40:37.673758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1309/2631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:37 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:37.677533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.678401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.679393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.680575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.681061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:37.681428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.682051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:37.682609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.690267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.690946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.691590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.692538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:37.693228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:37.693807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:37.791519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:37.804204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:37.806834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:37.808303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6dba298-d25f-4e91-8914-c635aa5f34e9 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.163193 Aug 31 12:40:37.808900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1323/2632] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:37 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:37.919200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:37.932707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0427639-4def-4765-8935-1d13bcab53d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.256203 Aug 31 12:40:37.933334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1310/2633] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:38.681185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:38.682177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:38.693904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:38.694710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:38.695444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:38.696609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:38.697341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:38.700099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:38.709488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:38.710831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:38.723614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:38.724472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:38.725223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:38.727410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:38.728178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:38.728910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:38.973526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:38.988107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-43e080d0-3360-4f2f-8c7f-2ad36fcadf9e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.313238 Aug 31 12:40:38.988972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1324/2634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:38 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:38.996784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:38.997780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:39.007779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:39.008562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:39.009255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:39.010392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:39.011148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:39.011930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:39.072472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:39.086524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc6fe1e8-a31e-477e-a470-899a269c661e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.384363 Aug 31 12:40:39.087477 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1311/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:38 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:39.095937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:39.097282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:39.108252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:39.109469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:39.110233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:39.111507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:39.112211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:39.112934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:39.115597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:39.130847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:39.133886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:39.135918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5119cfc-f467-41b4-904a-bb3610eeecef tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.145171 Aug 31 12:40:39.137025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1325/2636] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:38 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:39.331523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:39.342439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15a56540-1b34-45b3-9a43-45b3c48766f3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.253318 Aug 31 12:40:39.345780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1312/2637] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:40.020524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:40.021619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:40.032732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.033522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.034192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.035314 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.036015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.036660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.121368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:40.122172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:40.133929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.134739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.135546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.136744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.137534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.138306 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.311292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:40.322391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-85f100b5-783c-4087-9926-684dc619ae1b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.308131 Aug 31 12:40:40.330631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1326/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:40 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:40.337221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:40.338380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:40.351532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.352477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.353322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.354611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.355545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.356303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.395642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:40.409714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-920e7a24-266b-4709-830b-a938b6807fa6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.294624 Aug 31 12:40:40.420457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1313/2639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:40 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:40.420457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:40.420457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:40.426324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.426845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.427942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.432024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:40.432024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:40.432024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:40.458716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:40.473707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:40.476510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:40.478365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1dbb1519-f64b-4561-899c-7c9cd95d1f0a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.146141 Aug 31 12:40:40.480111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1327/2640] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:40 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:40.636628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:40.650671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-521949fc-ba0f-4262-ac5f-d22318108686 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.238703 Aug 31 12:40:40.651594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1314/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:41.350964 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:41.351753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:41.359374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.359934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.360427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.361181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.361694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.363978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.450921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:41.452007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:41.463893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.464663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.465457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.467083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.467940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.468680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.656338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:41.667136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fedba95-1cba-4898-a0c1-4d48bc1236ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.320156 Aug 31 12:40:41.668148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1328/2642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:41 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:41.677604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:41.678783 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:41.691414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.692303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.693088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.694391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.695101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.695620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.754077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:41.764868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eaf211f7-416b-4597-b25a-b99a68157b0f tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.321190 Aug 31 12:40:41.765750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1315/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:41 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:41.785402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:41.786326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:41.794210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:41.796109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.796899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.797605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.798755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:41.799459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:41.800115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:41.809255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:41.811165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:41.812595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e0e114ca-4331-422e-b792-386669738ea1 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.143139 Aug 31 12:40:41.813258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1329/2644] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:41 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:42.059401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:42.077847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7d56c3b-db83-41e8-bdfe-679b0edbdb0f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.296201 Aug 31 12:40:42.078891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1316/2645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:42.705539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:42.706564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:42.714800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:42.715517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:42.717098 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:42.717571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:42.718126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:42.718673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:42.793677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:42.796835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:42.823309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:42.824337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:42.825003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:42.826329 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:42.827355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:42.828062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:43.013752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:43.033291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-df28a749-4e4a-4f93-85f1-e6669af1a46b tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.333949 Aug 31 12:40:43.034321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1330/2646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:42 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:43.042879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:43.045100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:43.066013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:43.066775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:43.067615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:43.068779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:43.069492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:43.070160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:43.166258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:43.183643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2503b07c-90f7-43bd-9a30-32a15c411512 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.397540 Aug 31 12:40:43.185209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1317/2647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:42 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:43.193912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:43.194273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:43.195121 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:43.209321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:43.210189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:43.210967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:43.211601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:43.213296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:43.214154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:43.214619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:43.214941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:43.219607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e7f5263b-de2f-4fd3-af38-b62974acf587 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.183506 Aug 31 12:40:43.220926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1331/2648] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:43 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:43.472677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:43.487618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-27c7cdb8-dac5-4c04-9f4f-917a0d771422 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.300558 Aug 31 12:40:43.488560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1318/2649] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:44.073763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:44.074958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:44.086889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.087766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.088530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.089759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.091683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.091683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.219325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:44.220470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:44.233453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.234340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.235127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.236407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.237224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.237994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.366640 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:44.385358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f2feb75a-9b9a-4fea-af79-f5433ae04403 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.318049 Aug 31 12:40:44.386420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1332/2650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:44 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:44.395945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:44.396848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:44.407718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.408619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.409361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.410651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.411455 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.412153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.554116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:44.560732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:44.562465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:44.573598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:44.576737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:44.577722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-619f9a5a-b47b-4931-825b-5adb2559b070 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.365708 Aug 31 12:40:44.578733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1319/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:44 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:44.578969 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-467aa9d5-3b1d-4ade-8edb-05fac536d2b8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.190816 Aug 31 12:40:44.580385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1333/2652] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:44 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:44.588181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:44.589262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:44.601557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.602377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.603131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.604441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:44.605258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:44.606689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:44.863621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:44.876958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eeafc463-41bb-49d4-ba2d-dce2a6f5beee tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.296337 Aug 31 12:40:44.877719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1320/2653] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:45.421864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:45.422891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:45.433956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.435664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.436403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.437552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.438300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.439007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.617048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:45.618152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:45.634550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.635478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.636293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.637643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.638677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.639492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.682610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:45.696885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c0ba561-76ec-465d-bfde-1adbc59594ce tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.282570 Aug 31 12:40:45.697956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1334/2654] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:45 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:45.706127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:45.707542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:45.718074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.718871 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.719608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.721093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.721821 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.722512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.882491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:45.898839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:45.901335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:45.906163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-faa026d3-8bc9-4550-ad5b-6f943da6cd0c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.206452 Aug 31 12:40:45.907577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1335/2655] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:45 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:45.917432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:45.918523 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:45.930186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.930986 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.931807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.933103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:45.933945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:45.934922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:45.942692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:45.956702 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aba21979-39ae-406f-92f4-473eaffc1e21 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.346511 Aug 31 12:40:45.957617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1321/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:45 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:46.172873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:46.186663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c9976f7-cf20-4b1a-8f7f-25673a748323 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.276773 Aug 31 12:40:46.187545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1336/2657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:46.735928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:46.736871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:46.748066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:46.748935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:46.749645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:46.750736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:46.751473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:46.752166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:46.945300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:46.946424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:46.957773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:46.958541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:46.959217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:46.960643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:46.961390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:46.962083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:47.001908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:47.017520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-376d36e4-7015-4f95-8455-93ef07bc8cdd tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.288178 Aug 31 12:40:47.018517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1322/2658] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:46 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:47.028653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:47.029815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:47.040527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:47.041524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:47.042429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:47.043657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:47.044616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:47.045389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:47.091425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:47.110153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:47.113198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:47.115401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b7911210-4cf7-4c5c-a8f3-aee075fc93c7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.176536 Aug 31 12:40:47.116362 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1337/2659] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:46 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:40:47.222513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:47.223618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:47.234771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:47.235581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:47.236277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:47.237420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:47.238149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:47.238850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:47.324966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:47.341107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0ce0915-798b-4808-b144-dc7413e3bc8c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.318601 Aug 31 12:40:47.341806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1323/2660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:47 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:47.439063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:47.453972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dce3d510-e6f1-4305-bef6-bcc55746c892 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.238557 Aug 31 12:40:47.454930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1338/2661] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:48.060738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:48.063546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:48.074665 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.075576 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.076645 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.077991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.078810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.079630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.119794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:48.160203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:48.161022 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:48.172394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.173171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.173867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.175018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.175775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.176472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.298148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:48.315025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:48.318190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:48.320440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70bf5c41-4a3e-4837-8456-349640ce8ccd tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.167377 Aug 31 12:40:48.321541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1339/2662] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:48 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:40:48.368389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:48.378357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:48.379377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:48.383669 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e1bf5dd7-a4a6-413e-ade6-60fe4fc1093a tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.330715 Aug 31 12:40:48.384620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1324/2663] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:48 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:48.389645 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.390676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.391457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.392686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.393739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.394418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.483260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:48.484751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:48.496935 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.498005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.499468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.500824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:48.501908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:48.502707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:48.769187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:48.784707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ac779ae2-731c-44e3-affd-e6b36ab9df94 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.412542 Aug 31 12:40:48.785718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1340/2664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:48 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:48.896776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:48.912771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b8a09f0-701e-442a-9680-b6886dbbebe5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.437066 Aug 31 12:40:48.913849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1325/2665] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:49.362068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:49.362995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:49.375841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.376699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.377384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.378744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.379627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.380400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.421120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:49.422058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:49.432134 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.432868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.433857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.435048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.435881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.436590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.515950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:49.533888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:49.537227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:49.539427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d363b83-b53f-4a35-a4f1-77a6f10efc7b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.183860 Aug 31 12:40:49.540759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1341/2666] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:49 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:40:49.801162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:49.822569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b2030ca-5e93-4a03-8eaa-2f94ad3302ae tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.408313 Aug 31 12:40:49.823125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:49.824528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:49.824751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1326/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:49 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:49.836848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.837736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.838937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.840520 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.841923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.843200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.953952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:49.955020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:49.966493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.967388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.968476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:49.969765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:49.970717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:49.971534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:50.127866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:50.143376 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f9539cb-382e-4cb6-8c2c-5b38be77dfe6 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.329422 Aug 31 12:40:50.144341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1342/2668] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:49 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:50.242236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:50.256450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-93cd8290-466c-4df1-82d1-6f494810299b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.310077 Aug 31 12:40:50.257354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1327/2669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:50.581864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:50.582809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:50.593998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:50.594698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:50.595377 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:50.596478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:50.597157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:50.597794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:50.711335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:50.726829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:50.729490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:50.731433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58105862-b3dc-4c84-aa96-da28ced20a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.155949 Aug 31 12:40:50.732443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1343/2670] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:50 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:50.859925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:50.861030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:50.869723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:50.870369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:50.870924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:50.872018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:50.873623 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:50.874052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.091767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:51.103166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2260d14b-20e1-47e2-91e3-d7365e7b3ae1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.248888 Aug 31 12:40:51.104074 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1328/2671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:50 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:51.290108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:51.290935 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:51.291507 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:51.292154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:51.302426 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:51.303163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:51.303881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.304967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:51.305877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:51.306804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.308247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:51.309283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:51.310255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.312023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:51.313273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:51.318404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.702575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:51.708147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:51.716233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1d3e3ff6-a547-4f79-88d0-a9104924aa59 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.432315 Aug 31 12:40:51.717583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1329/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:51.723198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-466b58c5-92ef-4526-8087-5dc2ab8718ce tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.548881 Aug 31 12:40:51.724116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1344/2673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:51 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:51.773999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:51.774840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:51.785917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:51.786720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:51.787474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.788680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:51.789379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:51.790049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:51.898304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:51.914496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:51.917301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:51.919164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b2973f1f-a538-433e-8adc-6de4393caaac tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.151976 Aug 31 12:40:51.920173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1330/2674] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:51 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:52.132790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:52.133623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:52.143943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:52.144739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:52.145408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:52.146572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:52.147498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:52.148320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:52.392886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:52.409000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9825d90e-50a2-415c-a57c-341d86578bf2 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.282465 Aug 31 12:40:52.410031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1345/2675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:52 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:52.751029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:52.752131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:52.760237 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:52.761193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:52.764043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:52.764872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:52.765690 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:52.766941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:52.767762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:52.768654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:52.772071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:52.772839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:52.773495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:52.774579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:52.775303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:52.775976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:53.114265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:53.123420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:53.130019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d7c4eea3-9364-4644-a047-5902441dec45 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.386157 Aug 31 12:40:53.131215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1331/2676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:53.138404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-058fd1fe-3ca5-481c-9de2-29d550c56d2e tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.384293 Aug 31 12:40:53.139897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1346/2677] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:52 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:53.140934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:53.141848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:53.149589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:53.150328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:53.151280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:53.152425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:53.153043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:53.153608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:53.257051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:53.273255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:53.276170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:53.278281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0045e7ba-b5d4-47da-a5f0-a6943981cc03 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.145413 Aug 31 12:40:53.279413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1332/2678] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:53 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:53.444367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:53.445348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:53.456397 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:53.457142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:53.457823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:53.458921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:53.459707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:53.460404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:53.698404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:53.713446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f9d5bfd3-c591-487e-8279-bec3fe09f04e tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.277783 Aug 31 12:40:53.714375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1347/2679] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:53 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:54.172473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:54.173383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:54.174065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:54.174245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:54.184269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.185023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.186062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.186399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.186941 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.187160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.188153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.188372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.188871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.189112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.189527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.189863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.580173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:54.587092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:54.595501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b26687d4-2bdf-4a15-8915-bcf9d491d87c tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.429286 Aug 31 12:40:54.596381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1348/2680] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:54 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:54.601609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d547b7eb-626e-401c-a08b-5322e147308b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.436889 Aug 31 12:40:54.602860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1333/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:54.606308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:54.607571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:54.618538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.619530 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.620367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.621712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.622493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.623383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.735537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:54.751399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:54.753722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:54.753976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:54.754925 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:54.755856 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-33c53591-9f00-4d4a-a12a-136e1aac1582 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.156900 Aug 31 12:40:54.756742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1349/2682] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:54 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:54.766619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.767499 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.768261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.769433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:54.770202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:54.770940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:54.997717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:55.012899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f1fc063c-e6f0-4291-8a80-80a127de0bf1 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.266685 Aug 31 12:40:55.014624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1334/2683] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:54 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:55.630700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:55.631675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:55.635704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:55.636723 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:55.643405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:55.644150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:55.644812 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:55.645978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:55.646686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:55.647380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:55.648131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:55.648967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:55.649720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:55.650920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:55.651746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:55.652498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:55.682238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:40:56.373020 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:56.378219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:56.390035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-13772471-7974-490f-a957-7944ed6af3da tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.765513 Aug 31 12:40:56.391058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1350/2684] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:55 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:56.392110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab56e0ee-32ed-4817-894a-580798e038d0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.763066 Aug 31 12:40:56.392979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1335/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:56.400344 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:56.401804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:56.402123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:56.403219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:56.413763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:56.414439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:56.414691 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:56.415306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:56.415672 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:56.416148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:56.417485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:56.417722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:56.418334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:56.418968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:56.419171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:56.419684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:56.583457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:56.598884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:56.601527 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:56.603411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-96ce672b-43bc-4988-8a7b-f954e5e8fb2e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.210689 Aug 31 12:40:56.604316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1351/2686] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:56.706229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:56.720838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8371ca30-7c7d-48b6-b60f-5a8f2e1e6c32 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.325806 Aug 31 12:40:56.721716 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1336/2687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:56 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:57.424746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:57.425943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:57.433506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:57.434897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:57.437556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.438374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.439154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.440418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.441167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.441883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.445490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.446232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.447167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.448319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.449015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.449662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.723118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:57.737312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:57.740236 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9cb2c966-60a8-48ee-bd52-6a0653b3206a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.314530 Aug 31 12:40:57.741530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1337/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:57.750976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:57.752163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:57.753619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c8f0d6c-36cf-4d83-8075-6d0d1593cf85 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.335454 Aug 31 12:40:57.757160 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1352/2689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:57 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:57.764071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.765369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.766109 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.766672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:57.767425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.767739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:57.768475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.769208 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.778723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.779218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.780310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.781620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:57.782350 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:57.782992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:57.938589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:57.953964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:57.956736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:57.959016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-93cc641c-e781-49f8-bbab-f8d38c1c9255 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.215523 Aug 31 12:40:57.960108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1338/2690] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:57 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:58.049797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:58.065625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-78a9b7e3-ed8d-4733-9b62-fb6ac2907aec tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.309324 Aug 31 12:40:58.066902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1353/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:57 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:40:58.769332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:58.770266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:58.779433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:58.780057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:58.780739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:58.783625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:58.784415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:58.785075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:58.788565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:58.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:58.798192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:58.798950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:58.799678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:58.800858 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:58.801594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:58.802282 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:59.159797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:59.171099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:59.171502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-925e24bb-944a-447d-a688-4dfc872fab16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.406304 Aug 31 12:40:59.172153 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1339/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:59.178060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:59.178666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:59.186484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:59.187166 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:59.187547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:59.188472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:59.189133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:59.189813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:59.190886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4513281c-c203-4f82-8e02-30d8be0ae2c2 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.406174 Aug 31 12:40:59.201957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1354/2693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:58 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:40:59.211168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:40:59.212308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:40:59.224220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:59.225079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:59.225835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:59.227113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:40:59.227988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:40:59.228738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:40:59.287851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:59.303636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:59.306676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:59.308366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09b71968-dc1e-4dcd-88d1-fb2db74b9099 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.134987 Aug 31 12:40:59.309065 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1340/2694] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:40:59 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:40:59.444343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:40:59.457333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ff0da931-ce09-462e-b70a-45f8ca0ad011 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.253633 Aug 31 12:40:59.458030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1355/2695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:40:59 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:00.206958 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:00.208005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:00.218161 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.218911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.219990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.221387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.222154 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.222865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.230212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:00.231025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:00.231207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:00.243346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.244111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.244814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.245976 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.246726 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.247473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.518234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:00.525774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:00.535950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-df0db86c-abc7-4f1c-a29e-d6fc21e384ab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.336120 Aug 31 12:41:00.536872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1341/2696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:00.543805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b52790b1-ec2a-4c53-9ae2-0c8c7ce30654 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.319491 Aug 31 12:41:00.548561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:00.549745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:00.552912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1356/2697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:00 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:00.565448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.566760 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.567410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.568292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.569068 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.569882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.570910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:00.574472 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:00.584287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.585316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.586154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.587401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:00.588088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:00.588863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:00.654882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:00.671606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:00.674382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:00.676609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7b46b74-fd06-4bc0-a70e-18f0868e3380 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.138083 Aug 31 12:41:00.677587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1342/2698] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:00 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:00.790545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:00.800610 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8dc7f00-525b-460c-8d14-e6425763dd94 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.246069 Aug 31 12:41:00.801214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1357/2699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:00 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:01.575333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:01.575998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:01.586544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.587385 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.587625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:01.588453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.588663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:01.589245 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.590052 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.590692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.600585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.601382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.602079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.603283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.604041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.604744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.829260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:01.840292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:01.841911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-20ad8979-e113-4a60-8c8d-8bd9e0bd910a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.269522 Aug 31 12:41:01.841911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1343/2700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:01.849006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:01.849634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:01.857257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aecde10f-f4cf-488e-8a07-b64df1ea9d61 tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.276125 Aug 31 12:41:01.859571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1358/2701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:01 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:01.868569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.868925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:01.869711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:01.878476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.878476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.878476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.878476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.879259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.886199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.887057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.888087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:01.889111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:01.890436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:01.891182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:02.012719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:02.024157 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:02.025918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:02.027417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dec2a492-d178-4df2-8f55-045d690416ab tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 200 len: 1444 microversion: 2.20 time: 0.183842 Aug 31 12:41:02.028247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1344/2702] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:01 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:02.072435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d81b7cf8-cd91-42c6-9940-75cc9b4afa70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '.version_select at 0x7fe854f29af0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:02.113900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d81b7cf8-cd91-42c6-9940-75cc9b4afa70 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504599038" status: 204 len: 0 microversion: 2.20 time: 0.048728 Aug 31 12:41:02.115090 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1345/2703] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Aug 31 12:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504599038 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 12:41:02.156982 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:02.172838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-db3fcb9a-fe77-4f21-9198-b1f50d0e70ea tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.311089 Aug 31 12:41:02.173814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1359/2704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:01 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:02.881575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:02.882924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:02.891678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:02.892471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:02.893091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:02.893993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:02.894657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:02.896337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:02.897587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:02.899101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] [instance: 8f08033a-e077-4eec-8c66-7ee2b37678a8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:02.911905 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:02.912813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:02.913706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:02.915356 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:02.916560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:02.917749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:03.183686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:03.190410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a3870e9df04d7795a649a21b722801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34eb3e0aba44efb8ddafedd89df4060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:03.198304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aeef6b2b-bf69-4718-9b7e-abd2b334985b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.320377 Aug 31 12:41:03.199258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1346/2705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:03.208497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:03.209413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] [instance: ada8fc37-de0f-4cbd-9c71-0ed57100787a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:03.214193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7acf2d9c-2bf8-4e25-9b78-7f8ba08456ac tempest-VolumesSnapshotTestJSON-88791795 tempest-VolumesSnapshotTestJSON-88791795-project] 10.222.0.27 "GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8" status: 200 len: 1558 microversion: 2.1 time: 0.326647 Aug 31 12:41:03.223266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1360/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:02 2022] GET /compute/v2.1/servers/8f08033a-e077-4eec-8c66-7ee2b37678a8 => generated 1558 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:03.237320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:03.238040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:03.238851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:03.240014 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:03.240845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:03.241518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:03.464444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0987854672d0472ea9dfdfa2d1900a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2188dd8748d540ee8df3689bd8538bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:03.475223 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ee8e6a6d-859b-4666-9c86-e54673916ff6 tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a" status: 200 len: 1601 microversion: 2.1 time: 0.274187 Aug 31 12:41:03.475868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1347/2707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:03 2022] GET /compute/v2.1/servers/ada8fc37-de0f-4cbd-9c71-0ed57100787a => generated 1601 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:03.498140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-30bebcaf-f3bb-4cc1-bea3-d452648db36f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] Calling method '.version_select at 0x7fe854d57790>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:03.542850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-30bebcaf-f3bb-4cc1-bea3-d452648db36f tempest-TestMinimumBasicScenario-1771240232 tempest-TestMinimumBasicScenario-1771240232-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1978415969" status: 202 len: 0 microversion: 2.1 time: 0.048584 Aug 31 12:41:03.544443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1361/2708] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Aug 31 12:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1978415969 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:41:03.563057 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-871a9ac6-14a8-4bdf-9a98-33c59deea99d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'create', calling method: .version_select at 0x7fe854f29b80>, body: {"keypair": {"name": "tempest-keypair-1025601443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp16lw/+oJeBNejaFm+J0MQaeAMPk3uR2HGAL++VJofCs1sVa9k9svIushzVGFbDMhMqWWIca8dLWPIV1gbyZq63tzFflRH62m/EtrOAmpih6HUMw/nYdfbnXhnbknx4A=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:03.573299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:03.601346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-871a9ac6-14a8-4bdf-9a98-33c59deea99d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for project f16c9f15d25f47a8a986290c237084d1. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:41:03.610187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-871a9ac6-14a8-4bdf-9a98-33c59deea99d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for user 09b76f14426c4241aa49812f06f35cd1 and project f16c9f15d25f47a8a986290c237084d1. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:41:03.657452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-871a9ac6-14a8-4bdf-9a98-33c59deea99d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.101659 Aug 31 12:41:03.659169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1348/2709] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Aug 31 12:41:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 12:41:04.250102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:04.250769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:04.264857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:04.266085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:04.267211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:04.269124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:04.269999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:04.270984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:04.677039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:04.701041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-80e67202-3f5b-43e1-b48e-3dab641848d4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.460269 Aug 31 12:41:04.704658 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1362/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:04 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:05.730293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:05.731592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:05.744620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:05.745614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:05.746635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:05.748321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:05.749363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:05.750209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:05.953872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1850486813", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97a2865d-237f-4283-9874-26a440ac7c91"}], "security_groups": [{"name": "tempest-securitygroup--1698837218"}], "key_name": "tempest-keypair-1025601443", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:06.219604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:06.231082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] validate_networks() for [('97a2865d-237f-4283-9874-26a440ac7c91', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:41:06.235865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4d7810ac-c5de-4015-a615-dc78a2554fc9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.513837 Aug 31 12:41:06.236916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1349/2711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:06.666890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:07.271345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:07.272149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:07.279711 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:07.280287 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:07.280840 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:07.281984 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:07.282480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:07.282912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:07.703443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:41:07.704355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:41:07.705182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:41:07.706830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:41:07.707554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:41:07.725150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:07.726450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:07.727210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:07.728599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:07.729800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:07.730510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:07.766768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for project f16c9f15d25f47a8a986290c237084d1. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:41:07.776639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Getting quotas for user 09b76f14426c4241aa49812f06f35cd1 and project f16c9f15d25f47a8a986290c237084d1. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:41:07.803638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:41:07.808743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:41:07.843112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:07.888774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c9e5174-87a1-4824-8e80-c41c696a9495 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.621212 Aug 31 12:41:07.903874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1350/2712] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:07.917716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a88366b2-859f-46c5-827b-4b7513acfc37 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.972042 Aug 31 12:41:07.918778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1363/2713] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Aug 31 12:41:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 12:41:07.940485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e3991853-a605-4d94-a4d6-8ffb05b3d3a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:07.941461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e3991853-a605-4d94-a4d6-8ffb05b3d3a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:08.074478 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3991853-a605-4d94-a4d6-8ffb05b3d3a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:08.087776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3991853-a605-4d94-a4d6-8ffb05b3d3a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:08.090543 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e3991853-a605-4d94-a4d6-8ffb05b3d3a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:08.091342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e3991853-a605-4d94-a4d6-8ffb05b3d3a7 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1282 microversion: 2.20 time: 0.158785 Aug 31 12:41:08.092199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1351/2714] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:07 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:08.932142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:08.935994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:08.952464 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:08.954000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:08.955171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:08.956839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:08.957948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:08.959059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:09.138755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:09.141896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:09.165426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:09.167093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:09.168396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:09.172593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:09.173931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:09.174832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:09.309127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:09.320985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:09.322505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:09.324547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2df351aa-e32f-4aef-87ed-c9be6d860a2d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1334 microversion: 2.20 time: 0.197436 Aug 31 12:41:09.332440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1352/2715] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:09 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1334 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:09.390243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:09.409284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5f1d2c2d-1fbe-4bc8-8fcb-807a69b1912d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.487804 Aug 31 12:41:09.416088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1364/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:10.370556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:10.371512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:10.386982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:10.387938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:10.388695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:10.390044 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:10.390683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:10.391278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:10.437747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:10.442418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:10.458299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:10.460190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:10.461286 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:10.472092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:10.472911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:10.473598 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:10.591479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:10.620108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:10.624532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:10.627392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a8dfb3f-02a3-4fa1-9ffe-32a8aac624e5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1340 microversion: 2.20 time: 0.264045 Aug 31 12:41:10.628618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1353/2717] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:10 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1340 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:10.831471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:10.844519 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ecd232a2-c7f9-4d6a-992a-4fd5b7fa8242 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.416564 Aug 31 12:41:10.845595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1365/2718] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:11.658004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:11.660295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:11.673085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:11.673895 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:11.674654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:11.675959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:11.676381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:11.676816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:11.876633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:11.876633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:11.887869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:11.888705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:11.889862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:11.891489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:11.892651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:11.893723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:12.067580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:12.084413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:12.092126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:12.094903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fa589507-d1ec-49b5-a20e-5ec180bf0c0f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.445098 Aug 31 12:41:12.097646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1354/2719] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:11 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:12.203123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:12.216556 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c2e4a8f7-88c0-4ad4-9eae-37b31514aaf3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.347203 Aug 31 12:41:12.217675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1366/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:12.334721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2b7a9aea-c97d-4f22-b1a7-5867faa4a8b2 req-5e65d226-df1e-4faf-9864-60a36d9d8d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d89bac1-2ed9-418f-aea8-10e6486b9e03", "tag": "a6392d48-6a2c-4a12-8789-0b7895416585"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:12.376699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2b7a9aea-c97d-4f22-b1a7-5867faa4a8b2 req-5e65d226-df1e-4faf-9864-60a36d9d8d6a service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:12.378015 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2b7a9aea-c97d-4f22-b1a7-5867faa4a8b2 req-5e65d226-df1e-4faf-9864-60a36d9d8d6a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:12.379149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2b7a9aea-c97d-4f22-b1a7-5867faa4a8b2 req-5e65d226-df1e-4faf-9864-60a36d9d8d6a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:12.409417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2b7a9aea-c97d-4f22-b1a7-5867faa4a8b2 req-5e65d226-df1e-4faf-9864-60a36d9d8d6a service nova] Creating event network-changed:a6392d48-6a2c-4a12-8789-0b7895416585 for instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 on hv-cinder-85535 Aug 31 12:41:12.421225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2b7a9aea-c97d-4f22-b1a7-5867faa4a8b2 req-5e65d226-df1e-4faf-9864-60a36d9d8d6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095515 Aug 31 12:41:12.422985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1355/2721] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:13.143946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:13.146423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:13.159698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:13.160863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:13.161584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:13.162904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:13.163690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:13.164480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:13.244471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:13.246422 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:13.254953 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:13.256255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:13.257102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:13.258503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:13.260343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:13.261017 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:13.450424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:13.488918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:13.490847 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:13.491054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:13.492088 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8715b52d-7847-4c1c-b3a5-081d3ee24bd2 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.356963 Aug 31 12:41:13.492665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1367/2722] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:13 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:13.519703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ede304b5-d2f6-47fd-ab2b-ffdf965e8e41 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.283787 Aug 31 12:41:13.520851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1356/2723] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:14.520754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:14.521725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:14.533264 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:14.535839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:14.541386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:14.542246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:14.546928 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:14.550602 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:14.551323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:14.555679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:14.564609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:14.568234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:14.569633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:14.574398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:14.575102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:14.576163 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:15.009710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:15.028273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:15.031412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9af0764b-b27d-4dfb-9916-65703c15831b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.493896 Aug 31 12:41:15.033235 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:15.045389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1357/2724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:14 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:15.052087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:15.055124 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:15.056798 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7a0b5e82-3d03-40c4-a64f-505f0435c1ae tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.542262 Aug 31 12:41:15.058275 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1368/2725] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:14 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:41:16.054580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:16.058110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:16.068779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:16.069706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:16.070421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:16.071501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:16.072404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:16.073106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:16.088132 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:16.091333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:16.109535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:16.111063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:16.112973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:16.114862 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:16.116804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:16.118140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:16.443517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:16.456678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4d1b7143-3e13-4601-bbfc-dba53fed8b22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.406313 Aug 31 12:41:16.468524 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1358/2726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:16.502504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:16.516723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:16.520999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:16.523063 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-77aee7d6-3cc2-4e57-b94f-1bc616ac4086 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.443463 Aug 31 12:41:16.523829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1369/2727] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:16 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:17.484366 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:17.485552 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:17.493727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:17.494433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:17.495258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:17.496588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:17.497476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:17.498293 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:17.567307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:17.570466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:17.584561 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:17.585048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:17.585642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:17.587330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:17.588827 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:17.589924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:17.744876 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:17.793766 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:17.812460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:17.823127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6776789f-5467-42de-b081-b2438b0a40d1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.344310 Aug 31 12:41:17.837923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1359/2728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:17.918384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:17.935045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:17.938807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:17.940922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a8a8bc96-2e60-4f5d-b616-e20cb542ccf5 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.382713 Aug 31 12:41:17.955525 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1370/2729] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:17 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:41:18.848887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:18.849868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:18.854070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:18.859444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:18.860268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:18.861129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:18.862536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:18.863296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:18.863894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:18.982008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:18.983047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:19.006292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:19.007184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:19.007983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:19.009253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:19.010307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:19.011051 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:19.175024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:19.211619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2310debf-31ce-42bf-aa78-3cc70dea5633 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.361135 Aug 31 12:41:19.216708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1360/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:18 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:19.400845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:19.416121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:19.418981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:19.420619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12b48a15-267a-424e-a79a-049666f84a5b tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.446518 Aug 31 12:41:19.426999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1371/2731] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:18 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:41:20.250407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:20.251307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:20.265467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:20.267390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:20.268642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:20.270338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:20.271920 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:20.273810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:20.379108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ead4b973-8e65-47b9-9a04-cf77a40f32a1 req-797a778c-f56c-4c14-b881-2820a579075d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d89bac1-2ed9-418f-aea8-10e6486b9e03", "name": "network-vif-plugged", "status": "completed", "tag": "a6392d48-6a2c-4a12-8789-0b7895416585"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:20.399151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ead4b973-8e65-47b9-9a04-cf77a40f32a1 req-797a778c-f56c-4c14-b881-2820a579075d service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:20.399940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ead4b973-8e65-47b9-9a04-cf77a40f32a1 req-797a778c-f56c-4c14-b881-2820a579075d service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:20.400567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ead4b973-8e65-47b9-9a04-cf77a40f32a1 req-797a778c-f56c-4c14-b881-2820a579075d service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:20.432728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ead4b973-8e65-47b9-9a04-cf77a40f32a1 req-797a778c-f56c-4c14-b881-2820a579075d service nova] Creating event network-vif-plugged:a6392d48-6a2c-4a12-8789-0b7895416585 for instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 on hv-cinder-85535 Aug 31 12:41:20.448605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ead4b973-8e65-47b9-9a04-cf77a40f32a1 req-797a778c-f56c-4c14-b881-2820a579075d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.460084 Aug 31 12:41:20.449916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1361/2732] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:20.475255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:20.480288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:20.491060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:20.495816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:20.496761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:20.503425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:20.505294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:20.506918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:20.536299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:20.777754 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:20.801438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c8b8680-7464-4c7f-986a-9f6a0af7dd38 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.554792 Aug 31 12:41:20.802490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1372/2733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:21.000928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:21.018638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:21.020854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:21.028003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8610e860-268a-4ede-b76c-c300fbbb5342 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.561666 Aug 31 12:41:21.029301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1362/2734] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:20 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:21.831778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:21.832885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:21.842588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:21.843507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:21.844190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:21.845279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:21.846127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:21.846947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:22.063326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:22.066539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:22.095380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:22.110178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:22.111312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-60d47c90-6147-443f-9fa9-51da8f7061d7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.286212 Aug 31 12:41:22.118418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:22.118974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:22.120254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:22.122010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:22.123753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:22.124774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1373/2735] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:22.395827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:22.406315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:22.410114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:22.412336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-326507d1-40d4-492a-a17a-dd7ccf1c56cb tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1408 microversion: 2.20 time: 0.358613 Aug 31 12:41:22.430949 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1363/2736] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:22 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1408 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:41:23.141677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:23.145494 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:23.173612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.180987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.181843 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.184354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.187790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.202789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.448703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:23.451965 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:23.465888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.467671 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.468757 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.472110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.473662 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.474788 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.666199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:23.683542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-20f65ed3-e0e8-4a2f-a26f-968da4dec060 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.550320 Aug 31 12:41:23.700652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1374/2737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:23 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:23.859165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:23.879288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:23.887002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:23.889270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ffa4114c-ca7d-41c3-b413-10eecf347e2c tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1600 microversion: 2.20 time: 0.453691 Aug 31 12:41:23.890260 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1364/2738] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:41:23 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1600 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:41:23.931593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:23.932962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:23.947988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.949392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.950958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:23.952889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:23.954173 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:23.956467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:24.160960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b3ee2d1b-a30b-446a-b0a4-5b7d7d1e8a63 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.251131 Aug 31 12:41:24.162089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1375/2739] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Aug 31 12:41:23 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 12:41:24.709093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:24.709808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:24.729003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:24.729879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:24.730569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:24.749440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:24.749967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:24.750452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:25.400603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:25.448286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11762676-62f4-4ff3-80f4-6a3f91fb3c4d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.741306 Aug 31 12:41:25.451168 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1365/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:26.276137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-61de2227-8517-4bae-8b50-c97f8a7c1eae tempest-TestShelveInstance-945126168 tempest-TestShelveInstance-945126168-project] Action: 'create', calling method: .version_select at 0x7fe854b75160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1054362774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXMHPNB7aFQBFSkgQBZTVfgMweKBda9eAM+d5Kbc1Z0mRkP2pmZ4alVHMCW0nQz5CEneOB3sGNUcLRphZzxIIGNgR+9ojPyGjWupQSWNhR1m+/s4hB5ylR4KrfP+psGRg=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:26.294893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-61de2227-8517-4bae-8b50-c97f8a7c1eae tempest-TestShelveInstance-945126168 tempest-TestShelveInstance-945126168-project] Getting quotas for project a86e12cf23804019ad942a0a9fc245f0. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:41:26.300628 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-61de2227-8517-4bae-8b50-c97f8a7c1eae tempest-TestShelveInstance-945126168 tempest-TestShelveInstance-945126168-project] Getting quotas for user d852fb6149224e0bbf3020bd68afb610 and project a86e12cf23804019ad942a0a9fc245f0. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:41:26.331974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-61de2227-8517-4bae-8b50-c97f8a7c1eae tempest-TestShelveInstance-945126168 tempest-TestShelveInstance-945126168-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.221612 Aug 31 12:41:26.332973 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1376/2741] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:41:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:26.479047 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:26.481310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:26.495540 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:26.497106 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:26.498738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:26.500556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:26.501889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:26.503076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:26.881144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:26.902169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bcfceb87-6ffc-4a6b-9abc-792974d2167f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.432992 Aug 31 12:41:26.903780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1366/2742] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:27.026010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d89bac1-2ed9-418f-aea8-10e6486b9e03", "tag": "a6392d48-6a2c-4a12-8789-0b7895416585"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:41:27.059211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:27.059733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:27.060158 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:27.094739 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] Creating event network-changed:a6392d48-6a2c-4a12-8789-0b7895416585 for instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 on hv-cinder-85535 Aug 31 12:41:27.100240 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR oslo.messaging._drivers.impl_rabbit [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] [96f328ac-9d7f-45bf-b0d5-3d2c1077ca96] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:41:27.937432 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:27.939578 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:27.949830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:27.950379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:27.951095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:27.951944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:27.952488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:27.952901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:28.114648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] [96f328ac-9d7f-45bf-b0d5-3d2c1077ca96] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41534. Aug 31 12:41:28.124597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-8c862911-f088-43b7-9164-54cc0fed5bef req-edfa10a5-ac3a-41ad-b5d4-5cbbbee0784f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.261508 Aug 31 12:41:28.125522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1377/2743] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:41:28.193360 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:28.202594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-512cc5f2-9050-4042-a6e8-b75d4fc2d922 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.273896 Aug 31 12:41:28.203195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1367/2744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:29.230093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:29.231012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:29.238241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:29.238746 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:29.239185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:29.239959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:29.240428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:29.240867 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:29.438633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:29.448239 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b61ce94a-5d06-4c35-b24f-b7ad62e8fd8d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.225501 Aug 31 12:41:29.448841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1378/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:30.470411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:30.471311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:30.479340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:30.479947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:30.480480 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:30.481246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:30.481705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:30.482239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:30.704829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:30.722002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7ebdf665-29e3-4ce2-8910-808613c1a33e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.255216 Aug 31 12:41:30.722783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1368/2746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:31.760477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:31.761626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:31.774452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:31.775757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:31.776796 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:31.778893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:31.780217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:31.781400 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:31.974082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:31.988144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6df3822c-dd58-47d0-b92d-b9a614eaf5fc tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.235300 Aug 31 12:41:31.989107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1379/2747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:33.030050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:33.031112 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:33.043049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:33.043893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:33.044693 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:33.045998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:33.046752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:33.047567 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:33.574632 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:33.586196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0135c64c-07b0-4a49-9d82-da89b2e50c60 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.573386 Aug 31 12:41:33.586863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1369/2748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:34.610445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:34.611814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:34.619582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:34.620243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:34.620696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:34.621479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:34.622037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:34.622555 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:34.838688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:34.848448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4af58d4-5ac7-4a56-84e1-e50abff4f182 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.242321 Aug 31 12:41:34.849457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1380/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:34 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:35.876962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:35.879076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:35.883706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:35.895670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:35.896502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:35.897281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:35.898684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:35.899558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:35.900370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:36.144263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:36.155719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f29a93af-7e7c-4acc-83e0-97fef0e85775 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.286444 Aug 31 12:41:36.156550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1370/2750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:37.180654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:37.181539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:37.183722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:37.184554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:37.192425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:37.192979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:37.193457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:37.194318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:37.194921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:37.195477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:37.443943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:37.458168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c5b163b-65c7-4056-8c28-d15d3755b2ef tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.281597 Aug 31 12:41:37.458772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1381/2751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:38.482220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:38.483087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:38.491282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:38.491933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:38.492406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:38.493224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:38.493774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:38.494235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:38.673743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:38.683426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d272cf1-273f-4efb-8ed6-1435461f2ff2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.205865 Aug 31 12:41:38.684232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1371/2752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:39.706447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:39.707399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:39.715079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.715740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.716174 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.716911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:39.717351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:39.717817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:39.932991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:39.943631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-970d2d37-cc52-4dc5-a940-bea850ffe6c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.240421 Aug 31 12:41:39.944118 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1382/2753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:39 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:40.979160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:40.980300 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:40.993382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:40.994243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:40.995025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:40.996355 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:40.997184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:40.997945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:41.199381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:41.210519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0fc21b74-a933-460c-9073-373b433ec1e1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.238819 Aug 31 12:41:41.211347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1372/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:42.246781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:42.249709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:42.258322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:42.259150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:42.259757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:42.260605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:42.261165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:42.261711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:42.500372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:42.511830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18bb461b-233f-4296-ae2f-e54c98d9712c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.269545 Aug 31 12:41:42.512438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1383/2755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:43.553350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:43.554492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:43.558000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:41:43.558229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda (ip 10.222.0.27) !!! Aug 31 12:41:43.571763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:43.572630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:43.573427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:43.574717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:43.575562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:43.576333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:43.776609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:43.791169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1549abe8-e39a-44a3-9d7f-adbeee605b48 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.245200 Aug 31 12:41:43.792398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1373/2756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:43 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:44.814882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:44.815619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:44.823861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:44.824581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:44.825406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:44.826296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:44.826848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:44.827486 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:44.987559 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:44.998052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-05983b6b-6158-4222-83f4-cd3d3d292f22 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.187182 Aug 31 12:41:44.998654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1384/2757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:46.020694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:46.021495 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:46.028451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:46.028947 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:46.029384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:46.030127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:46.030575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:46.030998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:46.182939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:46.192689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-057a4bad-fe09-427f-80c3-f29d691dd44b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.176628 Aug 31 12:41:46.193280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1374/2758] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:47.216083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:47.216781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:47.224865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:47.225345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:47.226100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:47.226804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:47.227326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:47.227736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:47.230877 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=85 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:47.413219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:47.429740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-316ce12b-179f-4de1-bb2a-6892273d2bad tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.217832 Aug 31 12:41:47.430817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1385/2759] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:48.469058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:48.470053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:48.481993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:48.483349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:48.484088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:48.485985 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:48.486815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:48.487617 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:48.715525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:48.731817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b8a3bc08-6665-4285-ac6a-53b6434893b3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.269279 Aug 31 12:41:48.732823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1375/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:48 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:49.770199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:49.771374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:49.785977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:49.786809 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:49.787632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:49.788902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:49.789721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:49.790954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:50.182737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:50.194029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5e2261bb-0617-418f-9713-26fda9e41ed1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.431115 Aug 31 12:41:50.194953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1386/2761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:51.229612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:51.230621 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:51.238286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:51.239520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:51.239756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:51.240350 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:51.240806 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:51.241230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:51.244403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=83 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:41:51.445193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:51.455459 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-66e37c4a-32f6-4d6a-bff3-eb5715452e85 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.230173 Aug 31 12:41:51.456083 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1376/2762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:52.478599 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:52.479538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:52.487316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:52.488045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:52.488715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:52.489941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:52.490462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:52.490947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:52.666255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:52.678508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5b7f907d-285b-4144-a5ba-6818e3f084b8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.204939 Aug 31 12:41:52.679560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1387/2763] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:53.706767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:53.707519 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:53.716094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:53.717038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:53.717719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:53.718774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:53.719600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:53.720126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:53.965516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:53.994829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-52c284b7-35ea-4602-aa88-c43044c49913 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.293413 Aug 31 12:41:53.996026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1377/2764] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:53 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:55.031966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:55.032879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:55.042307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:55.042972 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:55.043572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:55.044553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:55.045424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:55.046130 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:55.274932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:55.286037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-535f210c-5378-423b-8ef3-d3b2419c8dbf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.258178 Aug 31 12:41:55.287927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1388/2765] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:41:56.309129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:56.310075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:56.318759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:56.319358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:56.319876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:56.320794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:56.321361 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:56.321832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:56.539421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:56.550137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cddaa3a8-273f-4f92-89c3-e507fa2ba75d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.245269 Aug 31 12:41:56.550738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1378/2766] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:57.577395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:57.578297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:57.590683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:57.591359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:57.591805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:57.592535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:57.592995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:57.593421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:57.800044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:57.813031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4fbef4a8-65c2-4ec9-8eb1-8f271250b38f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.242691 Aug 31 12:41:57.813637 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1389/2767] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:41:58.843481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:41:58.844549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:41:58.857254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:58.858119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:58.859143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:58.860504 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:41:58.861343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:41:58.862102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:41:59.088333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:41:59.111936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa35b1f9-eaae-4e7a-9c20-65d683b40e1c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.275778 Aug 31 12:41:59.112783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1379/2768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:41:58 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:00.152949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:00.153669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:00.161103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:00.162364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:00.162364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:00.163375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:00.163375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:00.164161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:00.367071 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:00.382736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-550fe0b0-9a83-4fb6-8149-620a6d153b23 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.236913 Aug 31 12:42:00.383822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1390/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:01.412476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:01.413597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:01.424633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:01.425467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:01.426217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:01.427602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:01.428389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:01.429118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:01.543911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:01.544835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:01.555572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:01.556423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:01.557382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:01.558717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:01.559540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:01.560296 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:01.609316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-27070203-6341-498b-8862-18f083e783a4 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03/ips" status: 200 len: 152 microversion: 2.20 time: 0.069369 Aug 31 12:42:01.610835 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1391/2770] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Aug 31 12:42:01 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03/ips => generated 152 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 12:42:01.639898 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:01.652670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1db4f7dd-3bcd-406c-b78e-7d9735ee4a7e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.248150 Aug 31 12:42:01.653791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1380/2771] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:02.679003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:02.679816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:02.686983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:02.687516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:02.687948 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:02.688662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:02.689108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:02.689534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:02.876048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:02.886374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9cec7da4-d709-48ae-91b1-eb1b4547ec0b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.212052 Aug 31 12:42:02.887166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1392/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:03.917395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:03.918587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:03.930445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:03.931463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:03.932271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:03.933498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:03.934320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:03.935087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:04.157916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:04.176969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13773b92-bc3b-40b6-8a09-50c348feb32c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.267027 Aug 31 12:42:04.178041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1381/2773] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:05.213162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:05.214280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:05.225887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:05.226716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:05.227459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:05.228987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:05.229772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:05.230534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:05.441604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:05.452208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40843cbe-0bb4-4f2c-8789-abe3dc448faf tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.246730 Aug 31 12:42:05.452863 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1393/2774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:05 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:06.478633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:06.479532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:06.482124 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=24 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:06.489087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:06.489841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:06.490694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:06.491663 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:06.492381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:06.492853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:06.689476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:06.705872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7749175c-7a6e-422e-a118-a45f814a14c5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.232081 Aug 31 12:42:06.706929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1382/2775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:06 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:07.743558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:07.744409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:07.746805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=26 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:07.754947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:07.755828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:07.756542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:07.757574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:07.758311 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:07.759087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:07.953933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:07.963765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5fbb3f74-80c7-455f-8e42-c9621e5a02d3 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.224257 Aug 31 12:42:07.965227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1394/2776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:07 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:09.003982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:09.005118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:09.017877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:09.018746 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:09.019583 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:09.020886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:09.021866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:09.022909 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:09.238570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:09.249745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-409b248f-b160-457a-b42b-1baea996fc16 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.253241 Aug 31 12:42:09.250425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1383/2777] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:08 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:10.274740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:10.275515 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:10.283865 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:10.284433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:10.284910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:10.285671 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:10.286163 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:10.286624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:10.457584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:10.468035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b3dea89-6fb9-4f1b-a5f5-137eb825363b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.198464 Aug 31 12:42:10.468789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1395/2778] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:10 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:11.494528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:11.495367 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:11.501853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:11.502338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:11.502773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:11.503521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:11.503975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:11.504398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:11.685246 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:11.700086 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3c8cfffc-a63f-452a-a6c2-fbb80ec833bb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.211021 Aug 31 12:42:11.700976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1384/2779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:11 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:12.729564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:12.730365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:12.738887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:12.739412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:12.739841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:12.740644 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:12.741183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:12.741604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:12.956172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:12.969579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ade0226-2c15-470f-86c9-86b63a22753c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.244851 Aug 31 12:42:12.970485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1396/2780] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:12 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:13.998242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:13.999384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:14.012289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:14.013205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:14.014049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:14.015362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:14.016200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:14.016972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:14.241753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:14.255801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9ee2cc3d-7012-4422-95c5-089cd952fd1f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.265021 Aug 31 12:42:14.256476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1385/2781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:13 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:15.289255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:15.290428 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:15.299769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.300307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.300712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.301438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:15.301895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:15.302323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:15.480284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:15.494953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-10ee51d0-1d17-4aa7-9a7b-55e2e4ba548d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.211976 Aug 31 12:42:15.495592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1397/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:15 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:16.518728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:16.519593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:16.530325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:16.530956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:16.531518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:16.532370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:16.532981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:16.533588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:16.741108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:16.752054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c4cf8192-fa99-40b3-a39b-5e435aa97241 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.237488 Aug 31 12:42:16.752728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1386/2783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:16 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:17.776903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:17.777580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:17.788469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:17.789104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:17.789595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:17.790490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:17.790988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:17.791577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:17.794757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=76 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:18.016694 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:18.031804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07336d31-d7fb-40c0-b55b-7e071b876194 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.259153 Aug 31 12:42:18.032722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1398/2784] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:17 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:19.067551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:19.068471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:19.076404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:19.076902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:19.077339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:19.078062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:19.078515 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:19.078943 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:19.305339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:19.321531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-be1244e1-d2ce-47e5-a2c9-36d64ebd12e5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.258327 Aug 31 12:42:19.322604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1387/2785] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:19 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:20.346305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:20.346990 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:20.356053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:20.356707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:20.357382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:20.358285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:20.358981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:20.359567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:20.518136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:20.533325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6815d2db-ffb7-4d8b-b546-9d8ccc54080b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.190941 Aug 31 12:42:20.534353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1399/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:20 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:21.558177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:21.559053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:21.566725 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:21.567486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:21.568012 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:21.568850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:21.570222 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:21.570826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:21.574486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=72 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:21.805533 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:21.815652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-03aa9d92-dd63-4279-a5be-4edb14e5f8e2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.263080 Aug 31 12:42:21.816149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1388/2787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:21 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:22.840886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:22.842006 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:22.855069 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:22.855906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:22.856761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:22.857924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:22.858741 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:22.859439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:23.050250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:23.060461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6f4428b7-13b3-4825-b3dd-f9c28fb24e76 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.226965 Aug 31 12:42:23.061041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1400/2788] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:22 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:24.082556 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:24.083311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:24.091123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:24.091679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:24.092283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:24.093131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:24.093627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:24.094143 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:24.253296 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:24.262773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-83a30ed8-fea7-468f-b7bc-7b6337472bca tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.184118 Aug 31 12:42:24.263479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1389/2789] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:24 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:25.287775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:25.288911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:25.297221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:25.297820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:25.298305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:25.299114 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:25.299742 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:25.300280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:25.510108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:25.523432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d105efcc-6ae8-4968-bf92-8b49febded7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.240791 Aug 31 12:42:25.524287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1401/2790] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:25 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:26.561670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:26.562969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:26.572783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:26.573436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:26.573983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:26.574879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:26.575493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:26.575964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:26.765692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:26.774864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0dc955e6-f048-4343-9018-09c711e9dc7f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.218024 Aug 31 12:42:26.775502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1390/2791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:26 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:27.799794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:27.800744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:27.809183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:27.809667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:27.810082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:27.810794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:27.811266 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:27.811690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:27.976395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:27.986384 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4bf14f81-3156-4322-bde5-ca6dbf98cd20 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.190683 Aug 31 12:42:27.986977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1402/2792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:27 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:29.013609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:29.014656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:29.022575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:29.023158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:29.023817 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:29.024644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:29.025150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:29.025615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:29.201325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:29.212116 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0d9f365-59f2-4af7-a882-9ec4e49801c0 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.206306 Aug 31 12:42:29.213048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1391/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:29 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:30.236633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:30.237352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:30.245983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:30.246800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:30.247540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:30.248790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:30.249651 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:30.250435 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:30.422650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:30.433820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a648f96-53bf-4d5a-8cba-6c7b53d96367 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.201177 Aug 31 12:42:30.434505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1403/2794] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:30 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:31.467133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:31.467922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:31.474875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:31.475397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:31.475848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:31.476604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:31.477048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:31.477461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:31.666305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:31.683797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ed2acfd5-76cd-4b21-8598-fc6ecafc7b2c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.220051 Aug 31 12:42:31.684886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1392/2795] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:31 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:32.711444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:32.712416 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:32.724492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:32.724966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:32.725679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:32.727477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:32.728307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:32.729053 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:32.950081 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:32.963039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d22d17de-e740-4714-a0c5-2b4cbb2876ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.258998 Aug 31 12:42:32.963881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1404/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:32 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:34.007969 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:34.009062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:34.021097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:34.021937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:34.022706 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:34.024291 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:34.025114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:34.027792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:34.208831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:34.218886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7447db09-3d3d-4a34-b0a1-f5bae7624eb9 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.217549 Aug 31 12:42:34.219518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1393/2797] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:33 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:35.246224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:35.246930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:35.253482 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:35.253985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:35.254399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:35.255121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:35.255612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:35.256037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:35.422320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:35.432406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cc2f3eef-6a66-4af9-8480-6917af5908c7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.190620 Aug 31 12:42:35.433300 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1405/2798] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:35 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:36.469532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:36.470475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:36.478554 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:36.479059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:36.479551 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:36.480289 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:36.481058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:36.481489 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:36.690764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:36.700744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f450d6d-0e48-424a-9883-aa31f549d552 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.235713 Aug 31 12:42:36.701575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1394/2799] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:36 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:37.726866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:37.728013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:37.740225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:37.741080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:37.741851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:37.743141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:37.744015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:37.744712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:37.958787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:37.968845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0305d0e-389a-46d9-81c9-71328792fc03 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.249043 Aug 31 12:42:37.969449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1406/2800] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:37 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:38.993562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:38.994652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:38.996936 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=26 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:39.003571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:39.004122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:39.004613 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:39.005368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:39.005855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:39.006380 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:39.176010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:39.185509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-63b18e0b-b426-4069-bd25-1f0964b88010 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.196720 Aug 31 12:42:39.186185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1395/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:38 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:40.208500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:40.209380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:40.211790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=26 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:40.220381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:40.221032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:40.221529 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:40.222326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:40.222853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:40.223461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:40.411953 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:40.427093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-070678ec-c478-41e4-8060-b53b086670fb tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.222775 Aug 31 12:42:40.428161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1407/2802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:40 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:41.465096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:41.466045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:41.477183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:41.477933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:41.478609 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:41.479847 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:41.480566 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:41.481563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:41.724436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:41.742084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac3be515-6031-4bc7-a7e5-3686de97870a tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.282491 Aug 31 12:42:41.743148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1396/2803] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:41 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:42.771317 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:42.772468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:42.784678 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:42.785541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:42.786308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:42.787616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:42.788418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:42.789184 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:42.989589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:43.000013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ad1c539-4966-4c9a-a8ad-b0182a480f7b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.236656 Aug 31 12:42:43.000738 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1408/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:42 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:44.030509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:44.033850 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:44.045917 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:44.046756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:44.047591 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:44.048890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:44.049683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:44.050417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:44.281561 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:44.292221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-235eecd1-1df1-4fb1-8df0-2768fd9ab8f8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.268632 Aug 31 12:42:44.293131 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1397/2805] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:44 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:45.403117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:45.404199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:45.415873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:45.416660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:45.417340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:45.418505 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:45.419209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:45.419919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:45.603851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:45.615395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f3c110ec-1582-45b7-9685-f7d58356c1be tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.219341 Aug 31 12:42:45.616116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1409/2806] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:45 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:46.639220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:46.640295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:46.651320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:46.652125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:46.652834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:46.654051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:46.654823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:46.655774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:46.864707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:46.873903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b9baa869-4e77-45a0-8eac-ed69d64f5d54 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.240716 Aug 31 12:42:46.874506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1398/2807] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:46 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:47.897848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:47.898950 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:47.906493 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:47.906985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:47.907473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:47.908169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:47.908632 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:47.909052 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:47.912056 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=72 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:48.094788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:48.105774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b3f7143e-7872-4071-8c8f-c59e654efee2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.212240 Aug 31 12:42:48.106717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1410/2808] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:47 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:49.129980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:49.130993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:49.138486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:49.139031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:49.139562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:49.140392 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:49.140954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:49.141481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:49.310722 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:49.320437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2f128656-882f-427c-a0b7-996ad9ff7a2d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.195086 Aug 31 12:42:49.321272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1399/2809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:49 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:50.346338 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:50.347057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:50.354689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:50.355341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:50.355912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:50.356732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:50.357656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:50.358111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:50.516212 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:50.526433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-46b9d0ac-148e-45f8-a19f-05d28ebd1f78 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.183892 Aug 31 12:42:50.527106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1411/2810] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:50 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:51.551851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:51.552741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:51.561060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:51.561709 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:51.562257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:51.563298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:51.564060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:51.564542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:51.592384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=74 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:42:51.774689 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:51.790128 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7c7bf120-6af4-47f5-9b11-55669296bae8 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.242190 Aug 31 12:42:51.791118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1400/2811] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:51 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:52.829274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:52.830427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:52.842349 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:52.843534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:52.844287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:52.845449 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:52.846744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:52.847070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:53.048097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:53.057970 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2a5d3ca-3a22-4398-bb61-b3e6282893ea tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.236130 Aug 31 12:42:53.058706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1412/2812] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:52 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:54.080987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:54.082209 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:54.090660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:54.091273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:54.091759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:54.092655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:54.093160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:54.093718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:54.266659 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:54.279191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a988f9b9-a73b-4546-8ef0-24b883b18f8e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.202571 Aug 31 12:42:54.279823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1401/2813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:54 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:55.309606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:55.310734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:55.323791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:55.324641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:55.325418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:55.326707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:55.327552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:55.328337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:55.521562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:55.533442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-277702f3-5919-4439-b080-e9f16ca4ac63 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.232132 Aug 31 12:42:55.534440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1413/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:55 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:56.558009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:56.558698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:56.565966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:56.566464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:56.566905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:56.567675 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:56.568420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:56.569005 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:56.773537 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:56.788079 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4d4ac5f1-78b1-41e7-b6e3-2f5fb0a82b8b tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.234248 Aug 31 12:42:56.789130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1402/2815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:56 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:42:57.822192 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:57.823375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:57.835404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:57.836230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:57.836951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:57.838405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:57.839201 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:57.839974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:58.059305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:58.069333 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e078fe88-a52a-4ffa-8dde-68a4fc4c4d5c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.254516 Aug 31 12:42:58.069997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1414/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:57 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:42:59.091401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:42:59.092043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:42:59.099526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:59.100004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:59.100436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:59.101122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:42:59.101563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:42:59.101976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:42:59.284647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:42:59.297751 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02ac35d5-6234-4399-b341-5b41015940c1 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.210355 Aug 31 12:42:59.298869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1403/2817] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:42:59 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:00.323957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:00.324699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:00.331706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:00.332322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:00.332937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:00.333760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:00.334308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:00.334823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:00.514337 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:00.524325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dd5c72de-0bd7-426e-adb7-7bd79b22428e tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.205595 Aug 31 12:43:00.526011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1415/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:00 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:01.546438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:01.547471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:01.556100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:01.556854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:01.557277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:01.558036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:01.558490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:01.558968 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:01.718562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:01.719508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:01.731354 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:01.732271 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:01.733358 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:01.734592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:01.735433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:01.736217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:01.737159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:01.748426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9e15c36-e69c-4870-8b4c-5a43b4554a5f tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.206086 Aug 31 12:43:01.749230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1404/2819] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:01 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:01.788977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:43:01.902643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-def25d9a-f87e-4d8b-b98b-c6e6eb6740ed tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 204 len: 0 microversion: 2.20 time: 0.190824 Aug 31 12:43:01.903406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1416/2820] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 31 12:43:01 2022] DELETE /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 12:43:01.912649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:01.913261 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:01.920379 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:01.920867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:01.921292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:01.921988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:01.922426 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:01.922839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:02.121761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:02.131798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:02.133420 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:02.134855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7c052d0-759a-4b5a-ba7b-34186e6df33e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1725 microversion: 2.20 time: 0.226766 Aug 31 12:43:02.135733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1405/2821] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:43:01 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 12:43:02.772254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:02.773024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:02.780090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:02.780570 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:02.780994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:02.781710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:02.782166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:02.782586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:02.951316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:02.962695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2927a8b3-d358-4e01-b74e-019bb37f8706 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.194340 Aug 31 12:43:02.963634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1417/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:02 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:03.167036 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:03.168402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:03.176501 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:03.177308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:03.177750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:03.178572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:03.179049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:03.179811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:03.349248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:03.360189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:03.361923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:03.363375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02c86d5d-275f-4182-9b6d-16a4c889c476 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1725 microversion: 2.20 time: 0.201661 Aug 31 12:43:03.364077 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1406/2823] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:43:03 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:43:03.986190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:03.987065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: aef8f7f2-486d-4c5d-984f-55bda8e6fbda] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:03.995608 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:03.996198 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:03.996695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:03.997440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:03.997901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:03.998429 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.242046 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:04.257504 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aa627c93-5836-4713-9925-2db9a5157598 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda" status: 200 len: 1735 microversion: 2.1 time: 0.275971 Aug 31 12:43:04.258440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1418/2824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:43:03 2022] GET /compute/v2.1/servers/aef8f7f2-486d-4c5d-984f-55bda8e6fbda => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:43:04.289054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-259294b9-d3ca-4275-8c37-add3794ef218 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '.version_select at 0x7fe854f70700>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:04.320951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-259294b9-d3ca-4275-8c37-add3794ef218 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419773043" status: 202 len: 0 microversion: 2.1 time: 0.036510 Aug 31 12:43:04.328747 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1407/2825] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 31 12:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419773043 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:43:04.392446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:04.394368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:04.406588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.407729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.408851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.410154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:04.411277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:04.412328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:04.959752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:04.980256 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:04.981831 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:04.984123 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d304ff01-a832-476f-89d2-6643617297a8 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1657 microversion: 2.20 time: 0.598756 Aug 31 12:43:04.984941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1419/2826] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:43:04 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1657 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:43:05.548470 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-767bb0a9-74a8-4677-8d5b-5ac74ee6fdf8 req-4ee79597-cc0c-439a-839c-9f69061679e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d89bac1-2ed9-418f-aea8-10e6486b9e03", "name": "network-vif-deleted", "tag": "a6392d48-6a2c-4a12-8789-0b7895416585"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:05.580037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-767bb0a9-74a8-4677-8d5b-5ac74ee6fdf8 req-4ee79597-cc0c-439a-839c-9f69061679e3 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:05.581280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-767bb0a9-74a8-4677-8d5b-5ac74ee6fdf8 req-4ee79597-cc0c-439a-839c-9f69061679e3 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:05.582322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-767bb0a9-74a8-4677-8d5b-5ac74ee6fdf8 req-4ee79597-cc0c-439a-839c-9f69061679e3 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:05.623446 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-767bb0a9-74a8-4677-8d5b-5ac74ee6fdf8 req-4ee79597-cc0c-439a-839c-9f69061679e3 service nova] Creating event network-vif-deleted:a6392d48-6a2c-4a12-8789-0b7895416585 for instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 on hv-cinder-85535 Aug 31 12:43:05.639611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-767bb0a9-74a8-4677-8d5b-5ac74ee6fdf8 req-4ee79597-cc0c-439a-839c-9f69061679e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333142 Aug 31 12:43:05.641396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1408/2827] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:43:06.026055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:06.028074 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:06.035627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:06.036524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:06.037604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:06.038601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:06.039469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:06.040070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:06.082606 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:06.083545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:06.084272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:06.085059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lazy-loading 'fault' on Instance uuid 1d89bac1-2ed9-418f-aea8-10e6486b9e03 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:43:06.165677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2694b2cc-2d14-4591-aaf5-cc178456c939 req-19db3ae2-8a67-434a-81c8-703c5a4a2523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:06.175548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:06.177123 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2694b2cc-2d14-4591-aaf5-cc178456c939 req-19db3ae2-8a67-434a-81c8-703c5a4a2523 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:06.177717 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2694b2cc-2d14-4591-aaf5-cc178456c939 req-19db3ae2-8a67-434a-81c8-703c5a4a2523 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:06.178204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2694b2cc-2d14-4591-aaf5-cc178456c939 req-19db3ae2-8a67-434a-81c8-703c5a4a2523 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:06.193039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:06.195051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2694b2cc-2d14-4591-aaf5-cc178456c939 req-19db3ae2-8a67-434a-81c8-703c5a4a2523 service nova] Creating event network-changed:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:43:06.196059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09b76f14426c4241aa49812f06f35cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c9f15d25f47a8a986290c237084d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:43:06.198452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eee79cd0-6733-4090-b574-f51624f9d00d tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 200 len: 1372 microversion: 2.20 time: 0.177052 Aug 31 12:43:06.199414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1420/2828] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:43:06 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 12:43:06.218634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2694b2cc-2d14-4591-aaf5-cc178456c939 req-19db3ae2-8a67-434a-81c8-703c5a4a2523 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056900 Aug 31 12:43:06.220226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1409/2829] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:43:07.235433 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:07.236319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:07.243524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:07.244010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:07.244528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:07.245452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:07.245900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:07.246319 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:07.262441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] HTTP exception thrown: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Request method failure captured: Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 HTTP/1.1 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GbgULvqdfDIg6CPQvzhu-xusiijIuoyZydxBmAXwzyvB3FtU9OlnDdD9sHIxSXTZYlb4-p12r0c8ld2FCcVBAe74vU3p7RZx9_abvwI5thzN_k6hLf_EIfDZYGniIKcRH8zc-7H_xTUJ3W8WxHvepPA2Isy2jk_KR1WPnCTqP0-tA Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:43:07.264211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f16c9f15d25f47a8a986290c237084d1", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 09b76f14426c4241aa49812f06f35cd1 Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:07.267353 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '1d89bac1-2ed9-418f-aea8-10e6486b9e03'} Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:43:07.269084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:07.272932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:07.274565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Returning 404 to user: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:43:07.274565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-95755fec-d44f-4576-b5b9-32e40eff903a tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 404 len: 111 microversion: 2.20 time: 0.035141 Aug 31 12:43:07.274565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1421/2830] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:43:07 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 12:43:07.281214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1c2ccd57-6045-425c-b517-642f4c42c492 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '.version_select at 0x7fe854d80430>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:07.302286 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1c2ccd57-6045-425c-b517-642f4c42c492 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025601443" status: 204 len: 0 microversion: 2.20 time: 0.028568 Aug 31 12:43:07.302982 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1410/2831] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Aug 31 12:43:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025601443 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 12:43:08.235261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:08.236159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:08.246316 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:08.246807 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:08.247269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:08.247992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:08.248445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:08.248870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:08.265209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] HTTP exception thrown: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Request method failure captured: Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 HTTP/1.1 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GbgULvqdfDIg6CPQvzhu-xusiijIuoyZydxBmAXwzyvB3FtU9OlnDdD9sHIxSXTZYlb4-p12r0c8ld2FCcVBAe74vU3p7RZx9_abvwI5thzN_k6hLf_EIfDZYGniIKcRH8zc-7H_xTUJ3W8WxHvepPA2Isy2jk_KR1WPnCTqP0-tA Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:43:08.266832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f16c9f15d25f47a8a986290c237084d1", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 09b76f14426c4241aa49812f06f35cd1 Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.268743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '1d89bac1-2ed9-418f-aea8-10e6486b9e03'} Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:43:08.269795 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.271697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.273543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Returning 404 to user: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:43:08.273543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22cfad2f-7908-4a70-8640-776cd368ed2f tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 404 len: 111 microversion: 2.20 time: 0.041348 Aug 31 12:43:08.273543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1422/2832] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 31 12:43:08 2022] DELETE /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:43:08.278975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:43:08.279780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 1d89bac1-2ed9-418f-aea8-10e6486b9e03] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:43:08.287916 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:08.289404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:08.289404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:08.289719 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:08.289893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:08.290319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:08.305644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] HTTP exception thrown: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Request method failure captured: Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 HTTP/1.1 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GbgULvqdfDIg6CPQvzhu-xusiijIuoyZydxBmAXwzyvB3FtU9OlnDdD9sHIxSXTZYlb4-p12r0c8ld2FCcVBAe74vU3p7RZx9_abvwI5thzN_k6hLf_EIfDZYGniIKcRH8zc-7H_xTUJ3W8WxHvepPA2Isy2jk_KR1WPnCTqP0-tA Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:43:08.307517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f16c9f15d25f47a8a986290c237084d1", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 09b76f14426c4241aa49812f06f35cd1 Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.309494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '1d89bac1-2ed9-418f-aea8-10e6486b9e03'} Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:43:08.310383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. Aug 31 12:43:08.311854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:43:08.313183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Returning 404 to user: Instance 1d89bac1-2ed9-418f-aea8-10e6486b9e03 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:43:08.313183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6e6d9eb2-8c09-4c07-a93d-71285bf9720e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03" status: 404 len: 111 microversion: 2.20 time: 0.034154 Aug 31 12:43:08.313183 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1411/2833] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:43:08 2022] GET /compute/v2.1/servers/1d89bac1-2ed9-418f-aea8-10e6486b9e03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:43:55.926028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-290bd082-4253-4a18-8491-3c7cd1ed5614 req-ef098b8a-41ca-46fa-bea1-abad05bc2c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada8fc37-de0f-4cbd-9c71-0ed57100787a", "name": "network-vif-deleted", "tag": "e019afe6-6742-49d8-a13f-9401fa9407a3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:43:55.934108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:55.934945 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:43:55.936075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:43:55.936327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 31 12:43:55.939016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 12:43:55.959770 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-290bd082-4253-4a18-8491-3c7cd1ed5614 req-ef098b8a-41ca-46fa-bea1-abad05bc2c01 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:43:55.960624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-290bd082-4253-4a18-8491-3c7cd1ed5614 req-ef098b8a-41ca-46fa-bea1-abad05bc2c01 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:43:55.961348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-290bd082-4253-4a18-8491-3c7cd1ed5614 req-ef098b8a-41ca-46fa-bea1-abad05bc2c01 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:43:55.975994 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-290bd082-4253-4a18-8491-3c7cd1ed5614 req-ef098b8a-41ca-46fa-bea1-abad05bc2c01 service nova] Creating event network-vif-deleted:e019afe6-6742-49d8-a13f-9401fa9407a3 for instance ada8fc37-de0f-4cbd-9c71-0ed57100787a on hv-cinder-85535 Aug 31 12:43:55.982897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-290bd082-4253-4a18-8491-3c7cd1ed5614 req-ef098b8a-41ca-46fa-bea1-abad05bc2c01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064403 Aug 31 12:43:55.983853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1423/2834] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:45:55.169071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bff74b5-8e68-48fa-b0a3-36790413caa8] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 12:45:55.169762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:55.170467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=45 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:55.171804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:45:55.172594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:45:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add (ip 10.222.0.27) !!! Aug 31 12:45:55.174541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:45:55.174964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:45:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add (ip 10.222.0.27) !!! Aug 31 12:45:55.180510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:45:55.181002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:45:55.199801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:45:55.200389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:45:55.200831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:45:55.201545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:45:55.201990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:45:55.202402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:45:55.240010 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add HTTP/1.1 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:45:55.242755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.244857 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '6c5bbaea-c876-457f-bbdd-96c967d56add'} Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:45:55.245767 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.247354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.249989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:45:55.249989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-920e6428-a209-4c95-86d8-bda80eb38371 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 404 len: 111 microversion: 2.1 time: 0.078471 Aug 31 12:45:55.249989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1412/2835] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:45:55 2022] DELETE /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:45:55.257068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8ca93a4-1c4a-4044-babd-8dc211991fbb] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:45:55.258161 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:55.258907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:45:55.271627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:45:55.272355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 6c5bbaea-c876-457f-bbdd-96c967d56add] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:45:55.279722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:45:55.280216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:45:55.280697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:45:55.281467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:45:55.281954 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:45:55.282385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:45:55.314575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add HTTP/1.1 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:45:55.317345 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.319269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '6c5bbaea-c876-457f-bbdd-96c967d56add'} Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:45:55.320335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. Aug 31 12:45:55.322705 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:45:55.324557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 6c5bbaea-c876-457f-bbdd-96c967d56add could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:45:55.324557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ff78560-b661-4a39-9f17-4e4bb64fd9cf tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add" status: 404 len: 111 microversion: 2.1 time: 0.066270 Aug 31 12:45:55.325768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1424/2836] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:45:55 2022] GET /compute/v2.1/servers/6c5bbaea-c876-457f-bbdd-96c967d56add => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:49:56.066413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:49:56.067573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:49:56.072853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:56.074471 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:56.075990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:49:56.076314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:49:56.078964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:49:56.079769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:49:56.083259 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:49:56.083852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be (ip 10.222.0.27) !!! Aug 31 12:49:56.116670 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bff74b5-8e68-48fa-b0a3-36790413caa8] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42040. Aug 31 12:49:56.118856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:49:56.119618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:49:56.124573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:49:56.125932 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:49:56.126860 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:49:56.128630 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:49:56.137083 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:56.138910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:49:56.140241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:49:56.140582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054362774 (ip 10.222.0.27) !!! Aug 31 12:49:56.142197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:49:56.142718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054362774 (ip 10.222.0.27) !!! Aug 31 12:49:56.145155 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:49:56.145971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054362774 (ip 10.222.0.27) !!! Aug 31 12:49:56.158476 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a45b7a7-307c-40d8-b877-64d4ccc4813c tempest-TestShelveInstance-945126168 tempest-TestShelveInstance-945126168-project] Calling method '.version_select at 0x7fe8586afca0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:49:56.172365 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] HTTP exception thrown: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Request method failure captured: Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be HTTP/1.1 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GbgULvqdfDIg6CPQvzhu-xusiijIuoyZydxBmAXwzyvB3FtU9OlnDdD9sHIxSXTZYlb4-p12r0c8ld2FCcVBAe74vU3p7RZx9_abvwI5thzN_k6hLf_EIfDZYGniIKcRH8zc-7H_xTUJ3W8WxHvepPA2Isy2jk_KR1WPnCTqP0-tA Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:49:56.180339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f16c9f15d25f47a8a986290c237084d1", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 09b76f14426c4241aa49812f06f35cd1 Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.183741 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '6cd7c10d-e093-4252-a8a2-f47366d712be'} Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:49:56.186680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.189656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.192917 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8ca93a4-1c4a-4044-babd-8dc211991fbb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42052. Aug 31 12:49:56.193117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Returning 404 to user: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:49:56.193117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0e738021-0e18-4b24-a8cf-6891d47b5a25 tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 404 len: 111 microversion: 2.20 time: 0.127468 Aug 31 12:49:56.193117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1413/2837] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 31 12:49:56 2022] DELETE /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 12:49:56.200748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:49:56.201761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] [instance: 6cd7c10d-e093-4252-a8a2-f47366d712be] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:49:56.212768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:49:56.213547 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:49:56.214352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:49:56.215597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:49:56.216384 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:49:56.217678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:49:56.227715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a45b7a7-307c-40d8-b877-64d4ccc4813c tempest-TestShelveInstance-945126168 tempest-TestShelveInstance-945126168-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054362774" status: 202 len: 0 microversion: 2.1 time: 0.094319 Aug 31 12:49:56.228711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1425/2838] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Aug 31 12:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054362774 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 12:49:56.248864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] HTTP exception thrown: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Request method failure captured: Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be HTTP/1.1 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GbgULvqdfDIg6CPQvzhu-xusiijIuoyZydxBmAXwzyvB3FtU9OlnDdD9sHIxSXTZYlb4-p12r0c8ld2FCcVBAe74vU3p7RZx9_abvwI5thzN_k6hLf_EIfDZYGniIKcRH8zc-7H_xTUJ3W8WxHvepPA2Isy2jk_KR1WPnCTqP0-tA Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:49:56.251467 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f16c9f15d25f47a8a986290c237084d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f16c9f15d25f47a8a986290c237084d1", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: f16c9f15d25f47a8a986290c237084d1 Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214010328 Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 09b76f14426c4241aa49812f06f35cd1 Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214010328-project Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.254684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '6cd7c10d-e093-4252-a8a2-f47366d712be'} Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:49:56.256531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. Aug 31 12:49:56.259534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:49:56.262627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] Returning 404 to user: Instance 6cd7c10d-e093-4252-a8a2-f47366d712be could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:49:56.262627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-118fe698-1210-444d-b0b8-99af6956f13e tempest-AttachVolumeShelveTestJSON-214010328 tempest-AttachVolumeShelveTestJSON-214010328-project] 10.222.0.27 "GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be" status: 404 len: 111 microversion: 2.20 time: 0.057801 Aug 31 12:49:56.262627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1414/2839] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 31 12:49:56 2022] GET /compute/v2.1/servers/6cd7c10d-e093-4252-a8a2-f47366d712be => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:53:09.739368 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8ca93a4-1c4a-4044-babd-8dc211991fbb] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:53:09.740528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:09.741740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:53:09.741740 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee (ip 10.222.0.27) !!! Aug 31 12:53:09.743409 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:53:09.743618 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee (ip 10.222.0.27) !!! Aug 31 12:53:09.744756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:53:09.744962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee (ip 10.222.0.27) !!! Aug 31 12:53:09.754200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:09.754683 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:09.766593 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.767156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.767653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.768500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.768940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.769715 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.784661 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee HTTP/1.1 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:53:09.786291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.789495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '659e57d5-c27a-45e8-96b5-0a115cec46ee'} Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:09.793583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.797653 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.802060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:09.802060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-164ca296-2903-46ee-8b8c-8ab17634c915 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 404 len: 111 microversion: 2.1 time: 0.050587 Aug 31 12:53:09.802060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1426/2840] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:53:09 2022] DELETE /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:53:09.802456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bff74b5-8e68-48fa-b0a3-36790413caa8] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 12:53:09.803063 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:09.804089 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:09.808087 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:53:09.808376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee (ip 10.222.0.27) !!! Aug 31 12:53:09.811305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:53:09.811535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee (ip 10.222.0.27) !!! Aug 31 12:53:09.813904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:53:09.814140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 12:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee (ip 10.222.0.27) !!! Aug 31 12:53:09.822319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:09.822928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 659e57d5-c27a-45e8-96b5-0a115cec46ee] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:09.835285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.836113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.836546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.837273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.837720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.838136 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.856874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee HTTP/1.1 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:53:09.858435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.862071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '659e57d5-c27a-45e8-96b5-0a115cec46ee'} Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:09.863173 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. Aug 31 12:53:09.864885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.867062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 659e57d5-c27a-45e8-96b5-0a115cec46ee could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:09.867062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2517a165-4c50-4258-a4a0-518b8ec73773 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee" status: 404 len: 111 microversion: 2.1 time: 0.065075 Aug 31 12:53:09.867062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1415/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:09 2022] GET /compute/v2.1/servers/659e57d5-c27a-45e8-96b5-0a115cec46ee => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:53:09.872614 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:09.873274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:09.882202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.882698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.883135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.883872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.884323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.884745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.900546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 HTTP/1.1 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:53:09.902166 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.906268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'fa04fef6-94a1-4065-a428-01e95e76cdf4'} Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:09.907828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.911491 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.914900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:09.914900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8f3dcb82-b4a7-41a0-9c6f-6ef429ed672c tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 404 len: 111 microversion: 2.1 time: 0.036434 Aug 31 12:53:09.914900 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1427/2842] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:53:09 2022] DELETE /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:53:09.917266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:09.918118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: fa04fef6-94a1-4065-a428-01e95e76cdf4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:09.925856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.926411 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.926988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.927891 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:09.928538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:09.929082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:09.946967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 HTTP/1.1 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:53:09.950088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.952873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'fa04fef6-94a1-4065-a428-01e95e76cdf4'} Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:09.954878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. Aug 31 12:53:09.957797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:09.960215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance fa04fef6-94a1-4065-a428-01e95e76cdf4 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:09.960215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14187538-f407-4075-8b04-b2420cdc28a4 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4" status: 404 len: 111 microversion: 2.1 time: 0.041358 Aug 31 12:53:09.960215 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1416/2843] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:09 2022] GET /compute/v2.1/servers/fa04fef6-94a1-4065-a428-01e95e76cdf4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:53:53.612252 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.613285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:53.630914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.635066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.643404 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:53.645562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:53.648092 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:53.650447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:53.651832 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:53.654495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:53.707208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8ca93a4-1c4a-4044-babd-8dc211991fbb] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42398. Aug 31 12:53:53.722036 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:53:53.925257 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9adfe006-9ccb-4572-b9f6-8257d11c918d tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 204 len: 0 microversion: 2.1 time: 0.318856 Aug 31 12:53:53.926819 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1428/2844] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:53:53 2022] DELETE /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 12:53:53.941342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:53.945933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:53.955934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.957508 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:53:53.989043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:53.990610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:53.993262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:53.995496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:53.996438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:53.997558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:54.004248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bff74b5-8e68-48fa-b0a3-36790413caa8] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42416. Aug 31 12:53:54.530759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:53:54.539822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1dfda7a8-8adb-4673-bdd3-7b15ffde908c tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1507 microversion: 2.1 time: 0.607398 Aug 31 12:53:54.540430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1417/2845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:53 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1507 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:53:54.820841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:54.822149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:54.835049 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:54.847776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:54.849216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:54.850757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:54.852284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:54.853379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:54.912583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 HTTP/1.1 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:53:54.917621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.919667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '991ff4bb-6c07-4c69-b673-272a1e178100'} Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:54.920676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.922183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.926224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:54.928776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-71824707-4432-4509-a268-b61a1f37fc7d tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 404 len: 111 microversion: 2.1 time: 0.124774 Aug 31 12:53:54.932690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1429/2846] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:53:54 2022] DELETE /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:53:54.943699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:54.944638 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] [instance: 991ff4bb-6c07-4c69-b673-272a1e178100] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:54.951423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:54.951929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:54.952650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:54.953721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:54.954440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:54.955097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:54.977626 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] HTTP exception thrown: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Request method failure captured: Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 HTTP/1.1 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpDtZPcQeQJxpJpYGulcElDcJqqdWFOVPtAVlAo7dJpFQHYGerKRWJlu95ic9BOiEhHD3Z9myI70LWYoxfq0ZzpsD8jPxnvFA5m6_0FSrQyFVT4nkoj7bTdiQXD1qz-LVd7Ivb6HArOLtVY-1v3YqYdheWsHY_P76mD0Thsq_8wB0 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:53:54.979902 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/16f3955065954f8f860bada6261223c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/16f3955065954f8f860bada6261223c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_16f3955065954f8f860bada6261223c4", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 16f3955065954f8f860bada6261223c4 Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-961624758 Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 4c3e5c1776b8470a9b677bac8dfbc9e6 Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-961624758-project Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.981521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '991ff4bb-6c07-4c69-b673-272a1e178100'} Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:54.982439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. Aug 31 12:53:54.984001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:53:54.987386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] Returning 404 to user: Instance 991ff4bb-6c07-4c69-b673-272a1e178100 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:54.988345 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b6498ad-ee56-4dfe-81dc-c645416e7753 tempest-AttachVolumeNegativeTest-961624758 tempest-AttachVolumeNegativeTest-961624758-project] 10.222.0.27 "GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100" status: 404 len: 111 microversion: 2.1 time: 0.049544 Aug 31 12:53:54.989397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1418/2847] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:54 2022] GET /compute/v2.1/servers/991ff4bb-6c07-4c69-b673-272a1e178100 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:53:55.600059 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:55.603722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:55.627167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:55.630633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:55.632042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:55.634882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:55.636309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:55.637642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:56.190107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:53:56.202669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-078b342b-4888-4a9f-9b1d-35e1853039fe tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1465 microversion: 2.1 time: 0.638566 Aug 31 12:53:56.205197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1430/2848] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:55 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1465 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:53:57.390793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-4c999538-cc9b-4648-b341-c56f784ff490 req-4bf393ce-d8fb-4940-9cc7-1dcba88b810b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a0e97b-c365-4cb4-b591-576e3babe5d6", "name": "network-vif-deleted", "tag": "20e76311-a9be-4882-8e61-7c32fc291409"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:53:57.412636 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4c999538-cc9b-4648-b341-c56f784ff490 req-4bf393ce-d8fb-4940-9cc7-1dcba88b810b service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:57.413135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4c999538-cc9b-4648-b341-c56f784ff490 req-4bf393ce-d8fb-4940-9cc7-1dcba88b810b service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:57.413575 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4c999538-cc9b-4648-b341-c56f784ff490 req-4bf393ce-d8fb-4940-9cc7-1dcba88b810b service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:57.442559 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-4c999538-cc9b-4648-b341-c56f784ff490 req-4bf393ce-d8fb-4940-9cc7-1dcba88b810b service nova] Creating event network-vif-deleted:20e76311-a9be-4882-8e61-7c32fc291409 for instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 on hv-cinder-85535 Aug 31 12:53:57.457688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-4c999538-cc9b-4648-b341-c56f784ff490 req-4bf393ce-d8fb-4940-9cc7-1dcba88b810b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.829387 Aug 31 12:53:57.461831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1419/2849] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:53:57.472146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:57.472893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:57.517247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:57.523488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:57.524824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:57.527190 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:57.530028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:57.530999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:57.628013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-29de4a1f-e2ec-44cf-8672-eb5d16b94f1c req-8c1ff016-fae9-4875-8d1d-53ffc98d1cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef8f7f2-486d-4c5d-984f-55bda8e6fbda", "name": "network-vif-deleted", "tag": "a7778db0-adf9-4ca0-9c57-e23226fea64f"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:53:57.660326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-29de4a1f-e2ec-44cf-8672-eb5d16b94f1c req-8c1ff016-fae9-4875-8d1d-53ffc98d1cc0 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:57.662893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-29de4a1f-e2ec-44cf-8672-eb5d16b94f1c req-8c1ff016-fae9-4875-8d1d-53ffc98d1cc0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:57.664881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-29de4a1f-e2ec-44cf-8672-eb5d16b94f1c req-8c1ff016-fae9-4875-8d1d-53ffc98d1cc0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:57.700410 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-29de4a1f-e2ec-44cf-8672-eb5d16b94f1c req-8c1ff016-fae9-4875-8d1d-53ffc98d1cc0 service nova] Creating event network-vif-deleted:a7778db0-adf9-4ca0-9c57-e23226fea64f for instance aef8f7f2-486d-4c5d-984f-55bda8e6fbda on hv-cinder-85535 Aug 31 12:53:57.711992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-29de4a1f-e2ec-44cf-8672-eb5d16b94f1c req-8c1ff016-fae9-4875-8d1d-53ffc98d1cc0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.646844 Aug 31 12:53:57.713186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1431/2850] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:53:57.750521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:57.756517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:57.757927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:57.759160 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'fault' on Instance uuid 04a0e97b-c365-4cb4-b591-576e3babe5d6 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:53:58.022577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:53:58.035119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-772d9158-37b3-4711-b921-f8a6bc8a0fab tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 200 len: 1311 microversion: 2.1 time: 0.571480 Aug 31 12:53:58.036803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1420/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:57 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 1311 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:53:59.071866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:59.074560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 04a0e97b-c365-4cb4-b591-576e3babe5d6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:59.092971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.093745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.094432 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.095592 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.096414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.097108 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.113305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] HTTP exception thrown: Instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 could not be found. Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Request method failure captured: Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 HTTP/1.1 Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1GpCnfPhE60MGW35xsKbWQymLH2VKfbkI8riuoyoErKnTaGSCbSjxJHTp3nA14pCNszMnYLak-gAikA7fQD08O00APmFXBcZXarjQNMSf5drcY4PF0Y3QT7FucqIAXv_g4UWE6nQ-UpiHVrwvs357GiMOlSO1u_7YlmdlMt4jfbLfE Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:53:59.115680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8687bcf9d2a242b5af329bce4a8ad6d9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: a8320be5e9644b6699ac526913e109eb Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 could not be found. Aug 31 12:53:59.117710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '04a0e97b-c365-4cb4-b591-576e3babe5d6'} Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 could not be found. Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:53:59.118605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 could not be found. Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 could not be found. Aug 31 12:53:59.120171 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:53:59.123327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Returning 404 to user: Instance 04a0e97b-c365-4cb4-b591-576e3babe5d6 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:53:59.126093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e50e4ecf-b8ed-43d3-bf69-a91b472ba864 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6" status: 404 len: 111 microversion: 2.1 time: 0.060346 Aug 31 12:53:59.127413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1432/2852] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:59 2022] GET /compute/v2.1/servers/04a0e97b-c365-4cb4-b591-576e3babe5d6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:53:59.149326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:59.154988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:59.178553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.179393 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.180167 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.181502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.183298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.183298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.242571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:53:59.449635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-281587bd-ea55-4269-8309-c2e19097aeb7 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 204 len: 0 microversion: 2.1 time: 0.316956 Aug 31 12:53:59.452101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1421/2853] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:53:59 2022] DELETE /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:53:59.465875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:53:59.466706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:53:59.480465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.480983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.481430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.485322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.485868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.486369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.506316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e70de852-d6e7-49ab-83fb-a2c013eda7f1 req-71f15b1a-77b1-4d33-bb1e-4bd0fa03fa66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f08033a-e077-4eec-8c66-7ee2b37678a8", "name": "network-vif-deleted", "tag": "2425ea5c-c7cd-4101-8bc9-7d903289d925"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:53:59.532897 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e70de852-d6e7-49ab-83fb-a2c013eda7f1 req-71f15b1a-77b1-4d33-bb1e-4bd0fa03fa66 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:53:59.533634 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e70de852-d6e7-49ab-83fb-a2c013eda7f1 req-71f15b1a-77b1-4d33-bb1e-4bd0fa03fa66 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:53:59.534264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e70de852-d6e7-49ab-83fb-a2c013eda7f1 req-71f15b1a-77b1-4d33-bb1e-4bd0fa03fa66 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:53:59.585237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e70de852-d6e7-49ab-83fb-a2c013eda7f1 req-71f15b1a-77b1-4d33-bb1e-4bd0fa03fa66 service nova] Creating event network-vif-deleted:2425ea5c-c7cd-4101-8bc9-7d903289d925 for instance 8f08033a-e077-4eec-8c66-7ee2b37678a8 on hv-cinder-85535 Aug 31 12:53:59.602372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e70de852-d6e7-49ab-83fb-a2c013eda7f1 req-71f15b1a-77b1-4d33-bb1e-4bd0fa03fa66 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116825 Aug 31 12:53:59.605315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1422/2854] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:54:00.516537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:00.538710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-992f2cd6-d50f-4e92-80c1-4ff9c2135edd tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1520 microversion: 2.1 time: 1.080989 Aug 31 12:54:00.555955 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1433/2855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:53:59 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1520 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:01.304216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2d0fb50b-61a4-4c19-b494-ebfcc61589bd req-96542914-e09d-45a6-b18f-464b537e6651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2c92aa-79af-4b50-93ca-50d2482f95d9", "name": "network-vif-deleted", "tag": "f1f3d314-f82c-4dad-8e8c-c4b929422a21"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:01.375406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2d0fb50b-61a4-4c19-b494-ebfcc61589bd req-96542914-e09d-45a6-b18f-464b537e6651 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:01.377948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2d0fb50b-61a4-4c19-b494-ebfcc61589bd req-96542914-e09d-45a6-b18f-464b537e6651 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:01.379070 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2d0fb50b-61a4-4c19-b494-ebfcc61589bd req-96542914-e09d-45a6-b18f-464b537e6651 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:01.484473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2d0fb50b-61a4-4c19-b494-ebfcc61589bd req-96542914-e09d-45a6-b18f-464b537e6651 service nova] Creating event network-vif-deleted:f1f3d314-f82c-4dad-8e8c-c4b929422a21 for instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 on hv-cinder-85535 Aug 31 12:54:01.541518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2d0fb50b-61a4-4c19-b494-ebfcc61589bd req-96542914-e09d-45a6-b18f-464b537e6651 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250343 Aug 31 12:54:01.543512 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1423/2856] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:54:01.594222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:01.595348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:01.645824 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:01.647889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:01.648785 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:01.652312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:01.653291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:01.657277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:01.818293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:01.818732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:01.819315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:01.819677 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'fault' on Instance uuid 4b2c92aa-79af-4b50-93ca-50d2482f95d9 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:54:02.000565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:02.016861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c65ceb2-0821-4faa-b05c-a8db9a7106c2 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1311 microversion: 2.1 time: 0.429915 Aug 31 12:54:02.032995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1434/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:01 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:03.053620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:03.054874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:03.070391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:03.071550 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:03.072280 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:03.073657 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:03.074399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:03.075271 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:03.147474 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:03.148503 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:03.150427 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:03.151413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'fault' on Instance uuid 4b2c92aa-79af-4b50-93ca-50d2482f95d9 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:54:03.237430 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:03.248974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7e8abad7-bb6a-4d30-8b67-36b633cb6aa4 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1311 microversion: 2.1 time: 0.212455 Aug 31 12:54:03.249954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1424/2858] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:03 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:04.289191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:04.290844 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:04.306789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:04.308028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:04.308971 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:04.310169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:04.310930 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:04.311922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:04.375875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:04.376696 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:04.377470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:04.378230 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lazy-loading 'fault' on Instance uuid 4b2c92aa-79af-4b50-93ca-50d2482f95d9 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:54:04.442597 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8320be5e9644b6699ac526913e109eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8687bcf9d2a242b5af329bce4a8ad6d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:04.453218 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-67003489-e992-4db8-8088-f2929f5ce0f5 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 200 len: 1311 microversion: 2.1 time: 0.170969 Aug 31 12:54:04.467885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1435/2859] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:04 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:05.483633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:05.486038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] [instance: 4b2c92aa-79af-4b50-93ca-50d2482f95d9] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:05.499874 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:05.501276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:05.502204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:05.504753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:05.505594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:05.506549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:05.536033 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] HTTP exception thrown: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 could not be found. Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Request method failure captured: Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 HTTP/1.1 Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1GpCnfPhE60MGW35xsKbWQymLH2VKfbkI8riuoyoErKnTaGSCbSjxJHTp3nA14pCNszMnYLak-gAikA7fQD08O00APmFXBcZXarjQNMSf5drcY4PF0Y3QT7FucqIAXv_g4UWE6nQ-UpiHVrwvs357GiMOlSO1u_7YlmdlMt4jfbLfE Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:54:05.539373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8687bcf9d2a242b5af329bce4a8ad6d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8687bcf9d2a242b5af329bce4a8ad6d9", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 8687bcf9d2a242b5af329bce4a8ad6d9 Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-586745822 Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: a8320be5e9644b6699ac526913e109eb Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-586745822-project Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 could not be found. Aug 31 12:54:05.541534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '4b2c92aa-79af-4b50-93ca-50d2482f95d9'} Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 could not be found. Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:54:05.542851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 could not be found. Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 could not be found. Aug 31 12:54:05.544988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:54:05.548880 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] Returning 404 to user: Instance 4b2c92aa-79af-4b50-93ca-50d2482f95d9 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:54:05.551654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14b249a1-98dc-4d7f-b337-ab3bc8da5269 tempest-ServerRescueNegativeTestJSON-586745822 tempest-ServerRescueNegativeTestJSON-586745822-project] 10.222.0.27 "GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9" status: 404 len: 111 microversion: 2.1 time: 0.077186 Aug 31 12:54:05.555334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1425/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:05 2022] GET /compute/v2.1/servers/4b2c92aa-79af-4b50-93ca-50d2482f95d9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:54:06.843548 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-90c08363-eb26-41b2-9165-b897c6495cd8 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe8586af1f0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:06.933959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-90c08363-eb26-41b2-9165-b897c6495cd8 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/7ba54687-9ef7-4f6d-a6a9-0749a9605617" status: 200 len: 351 microversion: 2.1 time: 0.096814 Aug 31 12:54:06.935220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1436/2861] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:54:06 2022] GET /compute/v2.1/os-volumes/7ba54687-9ef7-4f6d-a6a9-0749a9605617 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:08.634253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09fbaf6e-2200-4791-b77b-5205148b428d tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe854ea03a0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:08.730408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09fbaf6e-2200-4791-b77b-5205148b428d tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/cbed90ed-dbec-435e-99a1-9ed88a14896a" status: 200 len: 350 microversion: 2.1 time: 0.100056 Aug 31 12:54:08.731076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1426/2862] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:54:08 2022] GET /compute/v2.1/os-volumes/cbed90ed-dbec-435e-99a1-9ed88a14896a => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:10.474351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2641e4b5-7b62-4b0f-a3d1-ac01869ab21c tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe8586c6d30>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:10.644348 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2641e4b5-7b62-4b0f-a3d1-ac01869ab21c tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6d948b8c-9493-40d4-a130-577fd9cc25c7" status: 200 len: 350 microversion: 2.1 time: 0.186154 Aug 31 12:54:10.646260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1437/2863] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:54:10 2022] GET /compute/v2.1/os-volumes/6d948b8c-9493-40d4-a130-577fd9cc25c7 => generated 350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:10.667714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28e5ea05-8edd-4af4-977b-f83314d68071 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe855074280>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:10.875851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28e5ea05-8edd-4af4-977b-f83314d68071 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.219035 Aug 31 12:54:10.877088 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1427/2864] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Aug 31 12:54:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:10.905423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-338bb3fd-cb58-4d6e-be22-f9d1dd5eafdc tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe854b49a60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:11.080061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-338bb3fd-cb58-4d6e-be22-f9d1dd5eafdc tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.191104 Aug 31 12:54:11.081244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1438/2865] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Aug 31 12:54:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:11.106267 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9e444bc-ffb4-415b-adbe-a5f90a12a9c6 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe854e9f940>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:11.230228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9e444bc-ffb4-415b-adbe-a5f90a12a9c6 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.130992 Aug 31 12:54:11.232915 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1428/2866] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Aug 31 12:54:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:11.255870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6862baaf-fae7-45ee-a40c-942f66368e21 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe8586c31f0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:11.421144 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6862baaf-fae7-45ee-a40c-942f66368e21 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.172763 Aug 31 12:54:11.421730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1439/2867] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Aug 31 12:54:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:11.436865 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6a041e0b-95d7-4433-997b-418c2c95c203 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe854ed40d0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:11.544532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6a041e0b-95d7-4433-997b-418c2c95c203 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.111546 Aug 31 12:54:11.553952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1429/2868] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Aug 31 12:54:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:54:11.563039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bc5d893c-72a7-48d0-8b57-7fef12f9a7e5 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe8586bf940>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:11.734709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bc5d893c-72a7-48d0-8b57-7fef12f9a7e5 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.177111 Aug 31 12:54:11.736111 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1440/2869] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Aug 31 12:54:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:11.750463 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d5c2810-16a2-40f6-b3c9-f1fef71f5635 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe8551ede50>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:11.957319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d5c2810-16a2-40f6-b3c9-f1fef71f5635 tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.210183 Aug 31 12:54:11.959599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1430/2870] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Aug 31 12:54:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:11.983579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b8d65dc-7b0b-4e91-9422-0c0fd15b840b tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] Calling method '.version_select at 0x7fe8586bfa60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:12.110574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b8d65dc-7b0b-4e91-9422-0c0fd15b840b tempest-VolumesTestJSON-478579486 tempest-VolumesTestJSON-478579486-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.134101 Aug 31 12:54:12.111581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1441/2871] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Aug 31 12:54:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:20.604979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:20.606354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:20.846610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84559906-b009-4687-88ce-0cb283c47983 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: .version_select at 0x7fe854d77550>, body: {"keypair": {"name": "tempest-keypair-546931997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTDygSM5zmnryblaLDuWf66k4nD6KuoHIzA+LKaGvfpn8mzlo8UUoaN0Brc6PjEIdVyW8zFgqylQgAoKbOuI6BpfrPr8GWd1J0+aumBeW1tBFE23uAP1tsU1VGdwCYK0Q=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:20.866081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-84559906-b009-4687-88ce-0cb283c47983 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:54:20.872930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-84559906-b009-4687-88ce-0cb283c47983 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for user 454a193b26684746bc8c9278a1f1f175 and project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:54:20.917510 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84559906-b009-4687-88ce-0cb283c47983 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.319550 Aug 31 12:54:20.931598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1431/2872] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:54:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:23.677082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:23.678984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:23.687620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-798465170", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3af97f7-319b-4870-a914-820da543cdbb"}], "security_groups": [{"name": "tempest-securitygroup--1546973234"}], "key_name": "tempest-keypair-546931997", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:23.909469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] validate_networks() for [('a3af97f7-319b-4870-a914-820da543cdbb', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:54:24.868306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:54:24.869258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:54:24.869423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:54:24.869735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:54:24.870208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:54:24.885079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:24.885888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:24.886663 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:24.888340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:24.889330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:24.890105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:24.930164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:54:24.941462 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for user 454a193b26684746bc8c9278a1f1f175 and project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:54:24.960395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:54:24.964427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:54:25.062733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b4ddd2b8-bc3e-4fe8-bb9b-0434e1550f85 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.387971 Aug 31 12:54:25.064340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1442/2873] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:54:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:54:25.085155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13b62a2a-cc27-45c8-b571-2c59a77c29cf tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:25.086315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13b62a2a-cc27-45c8-b571-2c59a77c29cf tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:25.196210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13b62a2a-cc27-45c8-b571-2c59a77c29cf tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:25.212549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13b62a2a-cc27-45c8-b571-2c59a77c29cf tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1236 microversion: 2.1 time: 0.134676 Aug 31 12:54:25.216085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1432/2874] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:25 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1236 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:26.249633 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:26.250437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:26.261032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:26.262210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:26.263025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:26.264213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:26.264977 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:26.265797 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:26.385524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:26.396589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6c5f9c8-1480-402a-be1b-bcea2ae3a471 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1240 microversion: 2.1 time: 0.159944 Aug 31 12:54:26.397607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1443/2875] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:26 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1240 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:27.438437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:27.439513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:27.451437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:27.452277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:27.453364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:27.454899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:27.456122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:27.457159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:27.556534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:27.569232 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-17d001fc-61a9-46c7-9215-b9c80118e8ef tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1232 microversion: 2.1 time: 0.137764 Aug 31 12:54:27.569991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1433/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:27 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1232 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:28.593180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:28.594085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:28.604113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:28.604716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:28.605408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:28.606513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:28.607211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:28.608003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:28.724514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:28.735564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a6915dab-d607-4933-be34-ce79587aad2b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1232 microversion: 2.1 time: 0.147034 Aug 31 12:54:28.736343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1444/2877] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:28 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1232 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:29.772930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:29.774158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:29.790979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:29.791801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:29.792771 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:29.794138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:29.795225 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:29.800844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:29.951370 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:29.969095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a817db21-e92e-4165-9922-8f3084589fb8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1306 microversion: 2.1 time: 0.202877 Aug 31 12:54:29.971353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1434/2878] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:29 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1306 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:31.012957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:31.014141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:31.026044 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:31.027278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:31.028204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:31.029654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:31.030718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:31.031670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:31.266927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:31.276845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-413e24d3-7747-407d-bb3f-b6c05634e900 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.271565 Aug 31 12:54:31.287908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1445/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:31 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:31.604740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-372f8e8d-19cb-4bf7-930b-98359084ee37 req-f638f6e5-263a-4325-8064-1511e9077dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6690e73-5f4a-4c80-89f4-86b6b13e85b3", "tag": "9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:31.620560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-372f8e8d-19cb-4bf7-930b-98359084ee37 req-f638f6e5-263a-4325-8064-1511e9077dce service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:31.621159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-372f8e8d-19cb-4bf7-930b-98359084ee37 req-f638f6e5-263a-4325-8064-1511e9077dce service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:31.621811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-372f8e8d-19cb-4bf7-930b-98359084ee37 req-f638f6e5-263a-4325-8064-1511e9077dce service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:31.639920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-372f8e8d-19cb-4bf7-930b-98359084ee37 req-f638f6e5-263a-4325-8064-1511e9077dce service nova] Creating event network-changed:9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3 for instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 on hv-cinder-85535 Aug 31 12:54:31.646882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-372f8e8d-19cb-4bf7-930b-98359084ee37 req-f638f6e5-263a-4325-8064-1511e9077dce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045841 Aug 31 12:54:31.647481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1435/2880] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:32.302004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:32.303004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:32.313538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:32.314310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:32.315035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:32.316326 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:32.316975 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:32.317564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:32.520447 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:32.532749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-819507d2-af88-46ed-9a04-226d7067f80b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.235766 Aug 31 12:54:32.543553 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1446/2881] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:32 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:33.567808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:33.568783 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:33.575415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:33.576383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:33.576830 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:33.577750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:33.578184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:33.578614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:33.832753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:33.850055 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c64fd13e-66f8-4387-b96c-7b23141f184e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.290095 Aug 31 12:54:33.853237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1436/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:33 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:34.894463 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:34.895180 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:34.903533 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:34.904421 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:34.905277 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:34.907834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:34.908394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:34.908956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:34.915133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:34.957357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:35.177310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:35.193927 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a3f247b-f330-4fc8-986e-4b2b61ddbe52 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.304486 Aug 31 12:54:35.202361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1447/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:34 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:36.218263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:36.219226 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:36.222842 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:36.230740 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:36.231415 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:36.232022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:36.232946 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:36.233648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:36.234181 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:36.438174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:36.453347 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-82694fc8-8f27-4791-8213-0d19478b2aa8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.239529 Aug 31 12:54:36.454673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1437/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:36 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:37.476057 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:37.476885 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:37.483734 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:37.484233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:37.484893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:37.485641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:37.486091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:37.486566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:37.669926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:37.683542 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c57c5361-7c65-4d08-ab73-b1ba8913b7d5 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.211990 Aug 31 12:54:37.684276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1448/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:37 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:38.709821 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:38.710558 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:38.719159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:38.720067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:38.720520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:38.721429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:38.721903 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:38.722339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:38.885310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:38.894518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-252563b1-ff28-47c2-92eb-80167aa965b8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.189462 Aug 31 12:54:38.895276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1438/2886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:38 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:54:39.916352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:39.916999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:39.925015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:39.925567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:39.926041 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:39.926752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:39.927207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:39.927674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:40.098896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:40.117590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03156a8b-a3c2-4207-a010-07ec364fd3e8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.204715 Aug 31 12:54:40.119467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1449/2887] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:39 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:54:40.624921 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-69bd4775-b242-4414-8442-0f7945ec0bbe req-cb0a23c0-672a-4ff2-a379-2ce609e308b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6690e73-5f4a-4c80-89f4-86b6b13e85b3", "name": "network-vif-plugged", "status": "completed", "tag": "9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:40.635402 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-69bd4775-b242-4414-8442-0f7945ec0bbe req-cb0a23c0-672a-4ff2-a379-2ce609e308b0 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:40.636008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-69bd4775-b242-4414-8442-0f7945ec0bbe req-cb0a23c0-672a-4ff2-a379-2ce609e308b0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:40.636484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-69bd4775-b242-4414-8442-0f7945ec0bbe req-cb0a23c0-672a-4ff2-a379-2ce609e308b0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:40.650418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-69bd4775-b242-4414-8442-0f7945ec0bbe req-cb0a23c0-672a-4ff2-a379-2ce609e308b0 service nova] Creating event network-vif-plugged:9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3 for instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 on hv-cinder-85535 Aug 31 12:54:40.656187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-69bd4775-b242-4414-8442-0f7945ec0bbe req-cb0a23c0-672a-4ff2-a379-2ce609e308b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222080 Aug 31 12:54:40.656829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1439/2888] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:41.145984 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:41.146650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:41.154073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:41.154581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:41.155007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:41.155748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:41.156197 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:41.156625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:41.341995 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:41.357567 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a1c47a4d-b647-4a15-b9e4-09743d57dbc6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.215825 Aug 31 12:54:41.371845 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1450/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:41 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:42.383687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:42.384963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:42.394314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:42.394314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:42.394815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:42.395838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:42.396327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:42.396954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:42.576814 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:42.588146 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-74920c3e-3817-4529-8c26-408db4f8f5eb tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1362 microversion: 2.1 time: 0.210256 Aug 31 12:54:42.589135 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1440/2890] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:42 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:54:43.609932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:43.610937 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:43.620630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:43.622060 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:43.623082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:43.624826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:43.625589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:43.626228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:43.838030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:43.851199 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c8e389d-9cd0-4235-a8c7-1f4c75532445 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1548 microversion: 2.1 time: 0.245029 Aug 31 12:54:43.852268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1451/2891] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:43 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:54:43.900866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:43.900866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:43.922712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:43.923595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:43.924377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:43.925625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:43.926363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:43.926914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:44.066881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-799e6835-4997-4a44-99a6-a8f622b4a98d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174405 Aug 31 12:54:44.068450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1441/2892] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:54:43 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:45.862643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-646a0c64-c272-4377-b857-55099d3cd6ae req-af03b592-f2b8-40b6-b380-f376c643c163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6690e73-5f4a-4c80-89f4-86b6b13e85b3", "tag": "9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:45.903415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-646a0c64-c272-4377-b857-55099d3cd6ae req-af03b592-f2b8-40b6-b380-f376c643c163 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:45.904595 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-646a0c64-c272-4377-b857-55099d3cd6ae req-af03b592-f2b8-40b6-b380-f376c643c163 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:45.905616 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-646a0c64-c272-4377-b857-55099d3cd6ae req-af03b592-f2b8-40b6-b380-f376c643c163 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:45.930538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-646a0c64-c272-4377-b857-55099d3cd6ae req-af03b592-f2b8-40b6-b380-f376c643c163 service nova] Creating event network-changed:9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3 for instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 on hv-cinder-85535 Aug 31 12:54:45.943925 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-646a0c64-c272-4377-b857-55099d3cd6ae req-af03b592-f2b8-40b6-b380-f376c643c163 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087303 Aug 31 12:54:45.946234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1452/2893] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:49.335498 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-248328776", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "networks": [{"uuid": "62a5c434-31fa-4dce-933d-11e44f9979ad"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:49.434951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] validate_networks() for [('62a5c434-31fa-4dce-933d-11e44f9979ad', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:54:50.852387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:54:50.853454 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:54:50.853876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:54:50.854457 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:54:50.854980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:54:50.858098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:50.874991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:50.874991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:50.875342 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:50.876754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:50.877759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:50.878684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:50.889939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=45 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:50.905308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Getting quotas for project e025dc367b3a4349b1f708b7b3966d43. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:54:50.910562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Getting quotas for user 48ae2b062eb644059edfa65d61f60f78 and project e025dc367b3a4349b1f708b7b3966d43. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:54:50.923975 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:54:50.926990 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:54:50.980218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7d01d42-6aef-4f93-9361-55a0f2653843 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652793 Aug 31 12:54:50.981493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1442/2894] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:54:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:54:51.003205 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-abc9811e-954b-4810-a10b-04eec80b4b87 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:51.004512 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-abc9811e-954b-4810-a10b-04eec80b4b87 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:51.200569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-abc9811e-954b-4810-a10b-04eec80b4b87 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:51.217485 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-abc9811e-954b-4810-a10b-04eec80b4b87 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1213 microversion: 2.1 time: 0.223009 Aug 31 12:54:51.227406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1453/2895] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:50 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:52.266357 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:52.268564 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:52.290774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:52.292310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:52.293390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:52.294998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:52.296081 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:52.298234 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:52.446785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:52.466599 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6640e014-2ad7-42bf-9bbb-2e2d3bd897cf tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1265 microversion: 2.1 time: 0.214429 Aug 31 12:54:52.468755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1443/2896] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:52 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:53.501944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:53.503690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:53.512912 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:53.514077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:53.514814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:53.515893 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:53.516636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:53.517374 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:53.650813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:53.660424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40984a31-4264-4407-88e6-d337abdbcfda tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1271 microversion: 2.1 time: 0.162425 Aug 31 12:54:53.661759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1454/2897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:53 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:54:54.708633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:54.709730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:54.717513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:54.718285 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:54.718826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:54.719849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:54.720452 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:54.721002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:54.813541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:54.828431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f69b6e87-783c-46ea-a38d-574b02013a74 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1271 microversion: 2.1 time: 0.125242 Aug 31 12:54:54.833049 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1444/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:54 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:55.868793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:55.869965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:55.873852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:55.895978 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:55.896962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:55.898037 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:55.899765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:55.901962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:55.903190 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:55.914752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=65 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:54:56.227657 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:56.270590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4125fb9e-bc71-414f-88b6-a84122b3d728 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.409460 Aug 31 12:54:56.274848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1455/2899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:55 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:56.563894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-f65fc526-9258-41fb-aafb-45024e9e0da4 req-247e1836-a09f-4469-97b2-9025f17b8230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850da90b-3609-460d-b00f-8d5889aca72d", "tag": "01f0bcbc-02ac-4345-b1dc-f474a795fe87"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:54:56.603872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f65fc526-9258-41fb-aafb-45024e9e0da4 req-247e1836-a09f-4469-97b2-9025f17b8230 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:56.604721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f65fc526-9258-41fb-aafb-45024e9e0da4 req-247e1836-a09f-4469-97b2-9025f17b8230 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:56.605759 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f65fc526-9258-41fb-aafb-45024e9e0da4 req-247e1836-a09f-4469-97b2-9025f17b8230 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:56.642704 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-f65fc526-9258-41fb-aafb-45024e9e0da4 req-247e1836-a09f-4469-97b2-9025f17b8230 service nova] Creating event network-changed:01f0bcbc-02ac-4345-b1dc-f474a795fe87 for instance 850da90b-3609-460d-b00f-8d5889aca72d on hv-cinder-85535 Aug 31 12:54:56.652745 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-f65fc526-9258-41fb-aafb-45024e9e0da4 req-247e1836-a09f-4469-97b2-9025f17b8230 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092968 Aug 31 12:54:56.653813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1445/2900] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:54:57.322682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:57.324468 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:57.339187 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:57.340064 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:57.340913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:57.342514 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:57.344596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:57.346116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:57.807999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:57.826642 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcc2c1b9-a897-494a-bb56-57ed2542fe78 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.521161 Aug 31 12:54:57.841245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1456/2901] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:57 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:54:58.872667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:54:58.875438 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:54:58.892861 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:58.894284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:58.895343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:58.897113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:54:58.899338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:54:58.900594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:54:59.218386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:54:59.236040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a8218d16-b263-4acd-94c8-4a27f277af46 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.376441 Aug 31 12:54:59.237159 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1446/2902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:54:58 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:00.278443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:00.279169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:00.302816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:00.303246 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:00.309367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:00.310623 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:00.311343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:00.311983 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:00.623723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:00.638262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9cb9f853-18bc-4f62-9fc7-277467ae1f3b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.364483 Aug 31 12:55:00.641117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1457/2903] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:00 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:01.664695 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:01.666822 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:01.670451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:01.672027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:01.683453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:01.684542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:01.685263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:01.686399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:01.687468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:01.688421 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:01.946607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:01.963927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e5f91e24-2b20-40d0-a448-86e96a9a40a8 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.304605 Aug 31 12:55:01.968133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1447/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:01 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:02.597219 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-b6ce4947-b2af-440c-b241-be1ef9144bcc req-f436e4e2-aa10-4cdc-bbba-f49dd1eaa705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850da90b-3609-460d-b00f-8d5889aca72d", "name": "network-vif-plugged", "status": "completed", "tag": "01f0bcbc-02ac-4345-b1dc-f474a795fe87"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:02.612162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:02.628359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b6ce4947-b2af-440c-b241-be1ef9144bcc req-f436e4e2-aa10-4cdc-bbba-f49dd1eaa705 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:02.630028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b6ce4947-b2af-440c-b241-be1ef9144bcc req-f436e4e2-aa10-4cdc-bbba-f49dd1eaa705 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:02.631004 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b6ce4947-b2af-440c-b241-be1ef9144bcc req-f436e4e2-aa10-4cdc-bbba-f49dd1eaa705 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:02.659638 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-b6ce4947-b2af-440c-b241-be1ef9144bcc req-f436e4e2-aa10-4cdc-bbba-f49dd1eaa705 service nova] Creating event network-vif-plugged:01f0bcbc-02ac-4345-b1dc-f474a795fe87 for instance 850da90b-3609-460d-b00f-8d5889aca72d on hv-cinder-85535 Aug 31 12:55:02.670564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-b6ce4947-b2af-440c-b241-be1ef9144bcc req-f436e4e2-aa10-4cdc-bbba-f49dd1eaa705 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082128 Aug 31 12:55:02.672479 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1458/2905] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:03.013352 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:03.015678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:03.033481 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:03.036050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:03.037585 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:03.039646 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:03.041231 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:03.042458 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:03.298407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:03.310336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c4a61ffa-9767-4783-8a4a-19dc0dd2a9be tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.307139 Aug 31 12:55:03.311606 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1448/2906] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:03 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:04.356609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:04.357536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:04.368484 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:04.369281 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:04.369864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:04.370851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:04.371566 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:04.372285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:04.687043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:04.710699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea2ac3b9-48fb-4f4d-9dcb-ed3f28dc013b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1313 microversion: 2.1 time: 0.360040 Aug 31 12:55:04.712178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1459/2907] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:04 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:05.680292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-319a550f-3cf6-4f8e-af5b-ef9f2c0df2d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Action: 'create', calling method: .version_select at 0x7fe854e9f1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1853732473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBMQa+njaEd0FaNWbDKaKrvTvXBqeGaDGpgP94c7WPAPrVRp+YTnGp6qdy9INc/ZXw4IYMCDVobpNjSVlgBtrnp0WA3U/zhO/3xRB/6/6ElFVjph/c6mGMBoYzfcaZG6Q=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:05.703505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-319a550f-3cf6-4f8e-af5b-ef9f2c0df2d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:55:05.709928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-319a550f-3cf6-4f8e-af5b-ef9f2c0df2d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for user 171b9c24597545a1a5c8388849ef5819 and project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:55:05.734521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:05.735801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:05.739546 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-319a550f-3cf6-4f8e-af5b-ef9f2c0df2d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.326511 Aug 31 12:55:05.742544 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1449/2908] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:55:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:05.749607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:05.750323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:05.751062 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:05.752318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:05.753227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:05.753682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:06.129102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:06.140526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-34d98fe8-eb3f-4a5a-b4ce-8328bc6121d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1497 microversion: 2.1 time: 0.411498 Aug 31 12:55:06.141203 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1460/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:05 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:06.777032 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:06.778027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:06.791944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:06.792929 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:06.793778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:06.795629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:06.796530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:06.797472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:06.858441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:55:07.017330 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15e8ad85-eff6-4e20-ab87-82b05c5a5e91 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "DELETE /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 204 len: 0 microversion: 2.1 time: 0.250137 Aug 31 12:55:07.018425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1450/2910] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:55:06 2022] DELETE /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:55:07.031419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:07.032320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:07.040890 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:07.041587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:07.042280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:07.043540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:07.044147 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:07.044846 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:07.322307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:07.335315 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-abe73555-fde5-44ad-b92e-386165e58283 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1503 microversion: 2.1 time: 0.310133 Aug 31 12:55:07.351751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1461/2911] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:07 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:08.371864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:08.373115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:08.386893 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:08.387647 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:08.388372 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:08.389581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:08.390348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:08.391066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:08.668677 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:08.687667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-879e46fc-ca5f-4522-b346-1005320a1249 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1503 microversion: 2.1 time: 0.323729 Aug 31 12:55:08.689075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1451/2912] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:08 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:09.406268 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f210950d-d476-4505-b51d-0013acabe07b req-8f60dcad-90c8-434e-83a3-9de2cdc99f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850da90b-3609-460d-b00f-8d5889aca72d", "name": "network-vif-deleted", "tag": "01f0bcbc-02ac-4345-b1dc-f474a795fe87"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:09.418331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f210950d-d476-4505-b51d-0013acabe07b req-8f60dcad-90c8-434e-83a3-9de2cdc99f78 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:09.419206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f210950d-d476-4505-b51d-0013acabe07b req-8f60dcad-90c8-434e-83a3-9de2cdc99f78 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:09.419869 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f210950d-d476-4505-b51d-0013acabe07b req-8f60dcad-90c8-434e-83a3-9de2cdc99f78 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:09.450280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f210950d-d476-4505-b51d-0013acabe07b req-8f60dcad-90c8-434e-83a3-9de2cdc99f78 service nova] Creating event network-vif-deleted:01f0bcbc-02ac-4345-b1dc-f474a795fe87 for instance 850da90b-3609-460d-b00f-8d5889aca72d on hv-cinder-85535 Aug 31 12:55:09.462438 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f210950d-d476-4505-b51d-0013acabe07b req-8f60dcad-90c8-434e-83a3-9de2cdc99f78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059755 Aug 31 12:55:09.466028 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1462/2913] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:55:09.715395 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:09.716714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:09.745201 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:09.746016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:09.746752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:09.748027 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:09.748827 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:09.749610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:09.809756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:09.810942 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:09.811451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:09.812796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lazy-loading 'fault' on Instance uuid 850da90b-3609-460d-b00f-8d5889aca72d {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:55:09.868514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:09.881653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fdf7524c-2ad5-4ea2-aee4-d60c9ea30721 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 200 len: 1303 microversion: 2.1 time: 0.173546 Aug 31 12:55:09.882888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1452/2914] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:09 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:10.920710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:10.921672 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 850da90b-3609-460d-b00f-8d5889aca72d] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:10.929709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:10.930162 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:10.930625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:10.931399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:10.931855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:10.932279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:10.947940 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] HTTP exception thrown: Instance 850da90b-3609-460d-b00f-8d5889aca72d could not be found. Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Request method failure captured: Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d HTTP/1.1 Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1oWZHiwkJvk3alfrvuEUvbI63Cv2VlHt7oIrYCQJPvS0xPejtrUNhRvcp9pUnjntXzk_9Sgu5yux0THia-To-G30pC9WDGm5MD2k6LPJOL3E_xQYJ4UV2p83036Nb4gNWEDC0mn9LdaXAux-kTW-MPxjQsAG46LZ_e-5fhPBrbvZtQ Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: e025dc367b3a4349b1f708b7b3966d43 Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesActionsTest-1045933649 Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:55:10.949907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e025dc367b3a4349b1f708b7b3966d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e025dc367b3a4349b1f708b7b3966d43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e025dc367b3a4349b1f708b7b3966d43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e025dc367b3a4349b1f708b7b3966d43", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesActionsTest-1045933649 Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: e025dc367b3a4349b1f708b7b3966d43 Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesActionsTest-1045933649 Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesActionsTest-1045933649-project Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 48ae2b062eb644059edfa65d61f60f78 Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesActionsTest-1045933649-project Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 850da90b-3609-460d-b00f-8d5889aca72d could not be found. Aug 31 12:55:10.952274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '850da90b-3609-460d-b00f-8d5889aca72d'} Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850da90b-3609-460d-b00f-8d5889aca72d could not be found. Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:55:10.953823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850da90b-3609-460d-b00f-8d5889aca72d could not be found. Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850da90b-3609-460d-b00f-8d5889aca72d could not be found. Aug 31 12:55:10.957013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:55:10.959178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Returning 404 to user: Instance 850da90b-3609-460d-b00f-8d5889aca72d could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:55:10.959178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-823abb61-5e0f-49ac-8a2d-5ede96d6e290 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d" status: 404 len: 111 microversion: 2.1 time: 0.035153 Aug 31 12:55:10.959178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1463/2915] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:10 2022] GET /compute/v2.1/servers/850da90b-3609-460d-b00f-8d5889aca72d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:55:11.070836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1753615098", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "networks": [{"uuid": "62a5c434-31fa-4dce-933d-11e44f9979ad"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:11.160587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] validate_networks() for [('62a5c434-31fa-4dce-933d-11e44f9979ad', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:55:11.723377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:55:11.723913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:55:11.724488 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:55:11.724999 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:55:11.725534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:55:11.736627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:11.737369 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:11.738104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:11.739038 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:11.739707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:11.740239 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:11.760983 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Getting quotas for project e025dc367b3a4349b1f708b7b3966d43. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:55:11.766728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Getting quotas for user 48ae2b062eb644059edfa65d61f60f78 and project e025dc367b3a4349b1f708b7b3966d43. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:55:11.784802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:55:11.801026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:55:11.859685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ce57692b-0d33-424b-9f43-59462a3014ac tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792698 Aug 31 12:55:11.861117 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1453/2916] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:55:11.883607 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a3b9a705-1513-4fd1-912f-e6e789943cab tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:11.884790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a3b9a705-1513-4fd1-912f-e6e789943cab tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:11.945693 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a3b9a705-1513-4fd1-912f-e6e789943cab tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:11.956407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a3b9a705-1513-4fd1-912f-e6e789943cab tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1214 microversion: 2.1 time: 0.084690 Aug 31 12:55:11.957325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1464/2917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:11 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:12.977616 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:12.978266 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:12.987608 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:12.988229 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:12.988781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:12.989610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:12.990098 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:12.990743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:13.071839 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:13.081107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d376175-9f57-41fe-95ef-e6d7173faff9 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1266 microversion: 2.1 time: 0.107209 Aug 31 12:55:13.081820 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1454/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:12 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:14.105135 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:14.105967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:14.116526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:14.117611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:14.118840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:14.120541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:14.121495 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:14.122395 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:14.326676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:14.339861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-acaf7012-237b-4179-9c8a-1b188b8a0bfb tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.238719 Aug 31 12:55:14.340808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1465/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:14 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:14.918053 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-edf7ae0c-eb38-467d-937d-6fc95a676b2f req-4332f2c0-8ff3-4523-b486-f95d02227688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31", "tag": "4992e6d4-72e9-47a9-b815-ec96e2542624"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:14.936854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-edf7ae0c-eb38-467d-937d-6fc95a676b2f req-4332f2c0-8ff3-4523-b486-f95d02227688 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:14.937592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-edf7ae0c-eb38-467d-937d-6fc95a676b2f req-4332f2c0-8ff3-4523-b486-f95d02227688 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:14.938442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-edf7ae0c-eb38-467d-937d-6fc95a676b2f req-4332f2c0-8ff3-4523-b486-f95d02227688 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:14.957587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-edf7ae0c-eb38-467d-937d-6fc95a676b2f req-4332f2c0-8ff3-4523-b486-f95d02227688 service nova] Creating event network-changed:4992e6d4-72e9-47a9-b815-ec96e2542624 for instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 on hv-cinder-85535 Aug 31 12:55:14.964327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-edf7ae0c-eb38-467d-937d-6fc95a676b2f req-4332f2c0-8ff3-4523-b486-f95d02227688 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069381 Aug 31 12:55:14.965553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1455/2920] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:55:15.376412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:15.377375 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:15.388452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:15.389285 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:15.390033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:15.391204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:15.392047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:15.392784 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:15.600241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:15.609183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-08bf214b-f2b5-4ca5-baef-8b29d6e378d7 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.238711 Aug 31 12:55:15.609768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1466/2921] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:15 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:16.643736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:16.644974 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:16.651800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:16.652434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:16.653023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:16.653811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:16.654356 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:16.655102 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:16.844397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:16.853877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6b3a9cb2-96dd-4688-993a-8e168774a6dc tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.215372 Aug 31 12:55:16.854736 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1456/2922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:16 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:17.877040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:17.877040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:17.884761 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:17.885262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:17.885787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:17.886540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:17.887134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:17.887729 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:18.049997 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:18.059061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2135f23d-8633-4a6d-a3e0-590bc665e19a tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.186663 Aug 31 12:55:18.059690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1467/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:17 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:19.088853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:19.089513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:19.096592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:19.097064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:19.097494 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:19.098204 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:19.098998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:19.099460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:19.256319 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:19.265676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6bd54c29-30b7-4d83-866e-c4ee064a34d5 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.181052 Aug 31 12:55:19.266252 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1457/2924] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:19 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:20.287650 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:20.288202 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:20.295822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:20.296322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:20.296768 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:20.297488 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:20.297944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:20.298367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:20.458072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:20.474024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75156ca5-74ff-4aea-9636-e0784cae9a1d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.190308 Aug 31 12:55:20.475261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1468/2925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:20 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:20.710323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-736952ee-feca-4576-98a3-e712a94d4c9b req-8e46529c-9500-4124-9f1d-dc7276e30777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31", "name": "network-vif-plugged", "status": "completed", "tag": "4992e6d4-72e9-47a9-b815-ec96e2542624"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:20.730937 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-736952ee-feca-4576-98a3-e712a94d4c9b req-8e46529c-9500-4124-9f1d-dc7276e30777 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:20.731816 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-736952ee-feca-4576-98a3-e712a94d4c9b req-8e46529c-9500-4124-9f1d-dc7276e30777 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:20.732580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-736952ee-feca-4576-98a3-e712a94d4c9b req-8e46529c-9500-4124-9f1d-dc7276e30777 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:20.761195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-736952ee-feca-4576-98a3-e712a94d4c9b req-8e46529c-9500-4124-9f1d-dc7276e30777 service nova] Creating event network-vif-plugged:4992e6d4-72e9-47a9-b815-ec96e2542624 for instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 on hv-cinder-85535 Aug 31 12:55:20.771269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-736952ee-feca-4576-98a3-e712a94d4c9b req-8e46529c-9500-4124-9f1d-dc7276e30777 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068636 Aug 31 12:55:20.772497 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1458/2926] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:21.495951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:21.496744 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:21.504473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:21.504887 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:21.505321 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:21.506029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:21.506492 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:21.506919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:21.686714 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:21.697175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-328e757f-5675-4f85-8602-1d296790af2f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.205956 Aug 31 12:55:21.697717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1469/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:21 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:22.720560 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:22.721404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:22.725023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:22.725729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=10 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:22.726396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:22.733349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:22.733834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:22.734268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:22.735009 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:22.735525 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:22.735933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:22.741114 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:22.937858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:22.952781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-050ab55a-7ccc-49b3-aa24-c803e3dee86f tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1314 microversion: 2.1 time: 0.236340 Aug 31 12:55:22.953851 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1459/2928] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:22 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:23.987181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:23.988016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:23.991882 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:23.997054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:23.997540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:23.998000 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:23.998767 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:23.999216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:23.999728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:24.180914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:24.190442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75881055-698d-478c-bc8a-d1fbd25897b4 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1497 microversion: 2.1 time: 0.207251 Aug 31 12:55:24.191026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1470/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:23 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:24.926304 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:24.926972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:24.933679 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:24.934178 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:24.934611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:24.935363 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:24.935815 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:24.936243 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:24.964904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:55:25.056906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e6801906-9b59-42bb-80a3-199759402882 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 204 len: 0 microversion: 2.1 time: 0.134349 Aug 31 12:55:25.057721 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1460/2930] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:55:24 2022] DELETE /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:55:25.066802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:25.067474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:25.074580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:25.075068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:25.075550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:25.076254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:25.076699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:25.077115 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:25.237298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:25.245956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c53544a7-576e-4b98-a297-f5399a71948b tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1503 microversion: 2.1 time: 0.183545 Aug 31 12:55:25.246584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1471/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:25 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:25.508805 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1260430924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1853732473", "security_groups": [{"name": "tempest-secgroup-smoke-91613680"}], "block_device_mapping_v2": [{"uuid": "dd5d1c15-04f5-4fcb-93f8-2546262b8eb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd3933ce-2f4d-4c14-bacd-fbfaa9c0ca4b"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:25.642483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] validate_networks() for [('dd3933ce-2f4d-4c14-bacd-fbfaa9c0ca4b', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:55:26.133197 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:55:26.133780 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:55:26.134177 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:55:26.134592 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:55:26.135003 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:55:26.145321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:26.145804 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:26.146334 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:26.147164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:26.147648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:26.148078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:26.167408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:55:26.172214 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for user 171b9c24597545a1a5c8388849ef5819 and project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:55:26.242096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:55:26.244889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd5d1c15-04f5-4fcb-93f8-2546262b8eb0',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:55:26.270136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:26.271185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:26.274116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=36 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:26.280142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:26.280634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:26.281065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:26.281777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:26.282226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:26.282652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:26.286587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=84 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:26.414362 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c020d506-0d1b-4a7e-9a40-ba62949cc077 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.909860 Aug 31 12:55:26.415210 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1461/2932] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:55:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:55:26.429853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f63a6cb8-f5e8-4ad3-abca-ad5fd0008117 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:26.431191 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f63a6cb8-f5e8-4ad3-abca-ad5fd0008117 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:26.542843 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f63a6cb8-f5e8-4ad3-abca-ad5fd0008117 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:26.552061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f63a6cb8-f5e8-4ad3-abca-ad5fd0008117 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1095 microversion: 2.1 time: 0.129209 Aug 31 12:55:26.553082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1462/2933] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:26 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1095 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:26.571643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:26.586848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c29b66c0-ebfe-4716-bbc6-5f1bc7d1d57d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1503 microversion: 2.1 time: 0.322444 Aug 31 12:55:26.588103 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1472/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:26 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:27.383913 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2f965930-2747-4978-8bdd-4b0ffd19cd40 req-745d1205-fb03-4290-a002-6c37ca37c7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31", "name": "network-vif-deleted", "tag": "4992e6d4-72e9-47a9-b815-ec96e2542624"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:27.405383 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2f965930-2747-4978-8bdd-4b0ffd19cd40 req-745d1205-fb03-4290-a002-6c37ca37c7eb service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:27.407610 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2f965930-2747-4978-8bdd-4b0ffd19cd40 req-745d1205-fb03-4290-a002-6c37ca37c7eb service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:27.408387 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2f965930-2747-4978-8bdd-4b0ffd19cd40 req-745d1205-fb03-4290-a002-6c37ca37c7eb service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:27.428142 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2f965930-2747-4978-8bdd-4b0ffd19cd40 req-745d1205-fb03-4290-a002-6c37ca37c7eb service nova] Creating event network-vif-deleted:4992e6d4-72e9-47a9-b815-ec96e2542624 for instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 on hv-cinder-85535 Aug 31 12:55:27.437050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2f965930-2747-4978-8bdd-4b0ffd19cd40 req-745d1205-fb03-4290-a002-6c37ca37c7eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059367 Aug 31 12:55:27.438493 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1463/2935] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:55:27.574688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:27.575308 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:27.582728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:27.583224 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:27.583702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:27.584414 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:27.584870 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:27.585297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:27.624516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:27.625868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:27.637045 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:27.637776 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:27.638529 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:27.639844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:27.640666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:27.641476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:27.670577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:27.680109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f8fe191b-d3af-48ca-ad7d-b9015dd6a5dd tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1193 microversion: 2.1 time: 0.109443 Aug 31 12:55:27.680710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1473/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:27 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:27.691185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:27.691855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:27.692294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:27.692753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lazy-loading 'fault' on Instance uuid 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:55:27.753900 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ae2b062eb644059edfa65d61f60f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e025dc367b3a4349b1f708b7b3966d43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:27.767151 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b96fa84c-e076-49c0-8c3b-d6bb865003d1 tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 200 len: 1304 microversion: 2.1 time: 0.149561 Aug 31 12:55:27.767823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1464/2937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:27 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:28.720388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:28.721418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:28.730585 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:28.731522 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:28.731999 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:28.733091 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:28.733753 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:28.734331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:28.809656 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:28.812041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] [instance: 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:28.822968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:28.825434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:28.826219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:28.827155 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:28.828413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:28.829483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:28.830202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:28.837430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1dc79e83-4263-4be0-a689-b98fb01b583a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1211 microversion: 2.1 time: 0.122716 Aug 31 12:55:28.848700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1474/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:28 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1211 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:28.872455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] HTTP exception thrown: Instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 could not be found. Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Request method failure captured: Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 HTTP/1.1 Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1oWZHiwkJvk3alfrvuEUvbI63Cv2VlHt7oIrYCQJPvS0xPejtrUNhRvcp9pUnjntXzk_9Sgu5yux0THia-To-G30pC9WDGm5MD2k6LPJOL3E_xQYJ4UV2p83036Nb4gNWEDC0mn9LdaXAux-kTW-MPxjQsAG46LZ_e-5fhPBrbvZtQ Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: e025dc367b3a4349b1f708b7b3966d43 Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesActionsTest-1045933649 Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:55:28.876563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e025dc367b3a4349b1f708b7b3966d43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e025dc367b3a4349b1f708b7b3966d43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e025dc367b3a4349b1f708b7b3966d43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e025dc367b3a4349b1f708b7b3966d43", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesActionsTest-1045933649 Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: e025dc367b3a4349b1f708b7b3966d43 Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesActionsTest-1045933649 Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesActionsTest-1045933649-project Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 48ae2b062eb644059edfa65d61f60f78 Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesActionsTest-1045933649-project Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 could not be found. Aug 31 12:55:28.878918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31'} Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 could not be found. Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:55:28.880187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 could not be found. Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 could not be found. Aug 31 12:55:28.882108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:55:28.886714 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] Returning 404 to user: Instance 2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:55:28.888295 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-96ba347e-8762-47f4-ad3d-3dc73659408d tempest-VolumesActionsTest-1045933649 tempest-VolumesActionsTest-1045933649-project] 10.222.0.27 "GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31" status: 404 len: 111 microversion: 2.1 time: 0.090847 Aug 31 12:55:28.889611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1465/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:28 2022] GET /compute/v2.1/servers/2d8584c3-ff54-436d-9c7b-1b6dcb7f4c31 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:55:29.877388 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:29.879413 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:29.899572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:29.900662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:29.901237 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:29.902181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:29.902946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:29.903647 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:30.113896 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:30.120901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-b2125cf1-26b2-46bf-a5a3-c05f1fee64a2 req-624b440a-774d-4179-a5fc-6a38fcff2b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488801fc-4be4-4482-ac14-1c9b60f77a15", "tag": "2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:30.124712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1307b0cc-a483-47a6-92d3-7f94faf883df tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.254322 Aug 31 12:55:30.125589 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1475/2940] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:29 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:30.133979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b2125cf1-26b2-46bf-a5a3-c05f1fee64a2 req-624b440a-774d-4179-a5fc-6a38fcff2b27 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:30.134569 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b2125cf1-26b2-46bf-a5a3-c05f1fee64a2 req-624b440a-774d-4179-a5fc-6a38fcff2b27 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:30.135406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b2125cf1-26b2-46bf-a5a3-c05f1fee64a2 req-624b440a-774d-4179-a5fc-6a38fcff2b27 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:30.148997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-b2125cf1-26b2-46bf-a5a3-c05f1fee64a2 req-624b440a-774d-4179-a5fc-6a38fcff2b27 service nova] Creating event network-changed:2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0 for instance 488801fc-4be4-4482-ac14-1c9b60f77a15 on hv-cinder-85535 Aug 31 12:55:30.154778 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-b2125cf1-26b2-46bf-a5a3-c05f1fee64a2 req-624b440a-774d-4179-a5fc-6a38fcff2b27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039288 Aug 31 12:55:30.156456 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1466/2941] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:30.638191 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:30.639298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:30.650340 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:30.651439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:30.652517 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:30.653888 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:30.654811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:30.655634 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:30.685055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7309d848-5cb7-464d-bbbe-a1e9b856ad1f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.058267 Aug 31 12:55:30.685615 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1476/2942] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:55:30 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/ips => generated 146 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:55:31.161172 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:31.161764 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:31.168993 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:31.169483 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:31.169923 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:31.170650 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:31.171097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:31.171555 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:31.350496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:31.366108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e084218d-01f0-4834-92c0-a102c0ba7f97 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.209878 Aug 31 12:55:31.367667 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1467/2943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:31 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:32.389534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:32.390140 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:32.398270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:32.398757 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:32.399189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:32.399922 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:32.400373 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:32.400792 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:32.556532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:32.565157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-94147f05-9884-41bf-ab52-263c34c6860e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.179646 Aug 31 12:55:32.565735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1477/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:32 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:33.598793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:33.599648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:33.606686 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:33.607185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:33.608272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:33.608443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:33.608831 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:33.609257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:33.772262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:33.781255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2c769853-9c3e-4997-ba2b-cf02251d246b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.186827 Aug 31 12:55:33.784170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1468/2945] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:33 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:34.807156 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:34.808582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:34.820747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:34.821617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:34.822411 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:34.823781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:34.824635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:34.825379 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:35.012101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17e78db3-a321-4566-8fa5-d1b6347e2485"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:35.016590 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:35.025841 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:35.026899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:35.027966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:35.029375 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:35.030344 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:35.031187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:35.113370 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:35.127747 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-726146ab-7742-4d7c-b0c4-09072c29c528 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.327316 Aug 31 12:55:35.129420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1478/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:34 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:35.478364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-21e3a581-2034-4756-b595-d1293d93f2a0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474596 Aug 31 12:55:35.496031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1469/2947] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:55:35 2022] POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:36.158102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:36.160502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:36.175837 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:36.176830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:36.177682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:36.179459 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:36.180702 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:36.181881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:36.497042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:36.513791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a8d4204-4d12-4393-aa56-96727b62cd68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.363374 Aug 31 12:55:36.516359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1479/2948] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:36 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:37.556284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:37.557129 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:37.563404 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:37.564442 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=8 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:37.568970 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:37.569962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:37.570579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:37.571517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:37.572164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:37.572768 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:37.823542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:37.837637 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d937eb9-46ba-4114-a219-6faa27d5529a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.285393 Aug 31 12:55:37.838401 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1470/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:37 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:38.886502 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:38.887932 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:38.901839 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:38.902895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:38.903775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:38.905185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:38.905777 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:38.906364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:39.140572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:39.152405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7436b965-904a-4f1f-8121-7c72d7fad57b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.274619 Aug 31 12:55:39.166686 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1480/2950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:38 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:40.195189 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:40.196138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:40.207249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:40.208202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:40.208967 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:40.210346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:40.211652 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:40.212451 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:40.444021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:40.462048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61679578-d195-492c-9927-972520928822 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.273721 Aug 31 12:55:40.476213 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1471/2951] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:40 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:41.498709 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:41.502621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:41.517318 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:41.519107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:41.521233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:41.522774 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:41.524452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:41.527209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:41.837442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:41.849441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cd7674b3-bed0-47e1-99e2-14c9fffcf69d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.358751 Aug 31 12:55:41.851066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1481/2952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:41 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:42.883179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:42.883784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:42.891064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:42.891896 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:42.892565 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:42.895799 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:42.897107 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:42.897979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:43.118313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:43.134888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c41648ed-910f-4c61-88a1-3b4c3ac9ff12 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.255059 Aug 31 12:55:43.136144 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1472/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:42 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:43.404066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cdeec8a3-1178-4418-80dd-c4129b845be9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:43.417276 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdeec8a3-1178-4418-80dd-c4129b845be9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:43.417801 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdeec8a3-1178-4418-80dd-c4129b845be9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:43.418430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cdeec8a3-1178-4418-80dd-c4129b845be9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:43.542713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-887767d3-e83b-4147-94b7-9700ce974b82 req-cb0e3da8-a983-4b83-8fff-7cb898c7ddb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488801fc-4be4-4482-ac14-1c9b60f77a15", "name": "network-vif-plugged", "status": "completed", "tag": "2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:43.548196 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cdeec8a3-1178-4418-80dd-c4129b845be9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Going to try to stop instance {{(pid=120573) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 12:55:43.562056 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-887767d3-e83b-4147-94b7-9700ce974b82 req-cb0e3da8-a983-4b83-8fff-7cb898c7ddb7 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:43.562933 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-887767d3-e83b-4147-94b7-9700ce974b82 req-cb0e3da8-a983-4b83-8fff-7cb898c7ddb7 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:43.563755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-887767d3-e83b-4147-94b7-9700ce974b82 req-cb0e3da8-a983-4b83-8fff-7cb898c7ddb7 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:43.585885 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-887767d3-e83b-4147-94b7-9700ce974b82 req-cb0e3da8-a983-4b83-8fff-7cb898c7ddb7 service nova] Creating event network-vif-plugged:2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0 for instance 488801fc-4be4-4482-ac14-1c9b60f77a15 on hv-cinder-85535 Aug 31 12:55:43.592254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-887767d3-e83b-4147-94b7-9700ce974b82 req-cb0e3da8-a983-4b83-8fff-7cb898c7ddb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055861 Aug 31 12:55:43.595785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1473/2954] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:43.646322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cdeec8a3-1178-4418-80dd-c4129b845be9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action" status: 202 len: 0 microversion: 2.1 time: 0.250897 Aug 31 12:55:43.651399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1482/2955] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:55:43 2022] POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:55:43.664406 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:43.665604 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:43.690031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:43.690580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:43.691281 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:43.709023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:43.709836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:43.710612 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:44.013511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:44.047509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b265605-0251-4475-b8e4-bfe37a8e97ab tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.391587 Aug 31 12:55:44.056152 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1474/2956] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:43 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:44.164234 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:44.166177 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:44.179094 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:44.179818 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:44.180834 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:44.181779 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:44.182620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:44.183822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:44.381790 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:44.391283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66a0755d-71e4-46a0-aa87-8089a091adac tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.233428 Aug 31 12:55:44.392430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1483/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:44 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:45.088270 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:45.088890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:45.096410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:45.097598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:45.098230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:45.098987 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:45.099666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:45.100093 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:45.292922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:45.310193 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-deb54f00-5c09-4781-ac96-bb8b95015317 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.225253 Aug 31 12:55:45.311527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1475/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:45 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:45.428577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:45.430670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:45.444104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:45.445364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:45.446154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:45.447673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:45.448968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:45.449752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:46.169656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:46.186958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a1852ba-1c34-47f0-a823-cff6e18a8dce tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1265 microversion: 2.1 time: 0.766118 Aug 31 12:55:46.188992 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1484/2959] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:45 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1265 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:46.334836 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:46.335720 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:46.343910 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:46.344418 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:46.344919 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:46.345769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:46.346247 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:46.346687 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:46.563506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:46.567620 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:46.582882 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d3f418d3-5699-417b-a3a2-0f92f3f550d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.252225 Aug 31 12:55:46.583823 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1476/2960] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:46 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:47.227725 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:47.229172 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:47.243035 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:47.244443 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:47.245253 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:47.246939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:47.247881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:47.248974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:47.539012 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:47.557076 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-048710ed-b057-4d47-8682-bbd9d0b94a01 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1452 microversion: 2.1 time: 0.337207 Aug 31 12:55:47.558619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1485/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:47 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1452 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:47.580417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:47.582577 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:47.595141 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:47.596466 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:47.597211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:47.598391 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:47.599349 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:47.599950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:47.620473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:47.621437 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:47.638107 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:47.639208 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:47.640047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:47.641960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:47.642780 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:47.643743 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:47.928957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:47.934765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:47.944228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9bf36302-ce2f-4553-9857-9419ff7478df tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.330845 Aug 31 12:55:47.945134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1486/2962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:47 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:47.950829 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e89df349-504c-4a3b-8e6d-87a66c479f90 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1452 microversion: 2.1 time: 0.374408 Aug 31 12:55:47.952924 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1477/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:47 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1452 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:48.972733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:48.973624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:48.981372 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:48.981875 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:48.982579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:48.983574 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:48.984043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:48.984817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:49.330540 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:49.346401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8bf1ada9-f35e-4628-b333-1a70c6f731f7 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.378646 Aug 31 12:55:49.347668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1487/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:48 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:50.369683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:50.371186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:50.381448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:50.382316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:50.383040 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:50.384216 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:50.385138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:50.385772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:50.902899 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:50.908910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-595210b5-58c9-41e1-a7fa-4118be28741d req-c5df8324-9091-4c3f-98f3-74cd5c7e6158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488801fc-4be4-4482-ac14-1c9b60f77a15", "tag": "2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:55:50.928626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-595210b5-58c9-41e1-a7fa-4118be28741d req-c5df8324-9091-4c3f-98f3-74cd5c7e6158 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:50.929859 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-595210b5-58c9-41e1-a7fa-4118be28741d req-c5df8324-9091-4c3f-98f3-74cd5c7e6158 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:50.930789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-595210b5-58c9-41e1-a7fa-4118be28741d req-c5df8324-9091-4c3f-98f3-74cd5c7e6158 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:50.952665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:50.957557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-595210b5-58c9-41e1-a7fa-4118be28741d req-c5df8324-9091-4c3f-98f3-74cd5c7e6158 service nova] Creating event network-changed:2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0 for instance 488801fc-4be4-4482-ac14-1c9b60f77a15 on hv-cinder-85535 Aug 31 12:55:50.969305 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9947c696-ef63-40a7-86b1-f049ac2123f6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.603728 Aug 31 12:55:50.970508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-595210b5-58c9-41e1-a7fa-4118be28741d req-c5df8324-9091-4c3f-98f3-74cd5c7e6158 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070855 Aug 31 12:55:50.972310 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1488/2965] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:55:50.995313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1478/2966] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:50 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:55:52.024270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:52.026707 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:52.041841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:52.043386 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:52.044497 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:52.046194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:52.047367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:52.048424 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:52.404330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:52.422883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a1bf00ba-99a4-4cd5-830a-d511e73c543f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.405169 Aug 31 12:55:52.437724 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1489/2967] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:52 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:53.469312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:53.469981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:53.472879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:53.478978 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:53.479502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:53.479939 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:53.480660 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:53.481108 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:53.481516 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:53.638765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:53.647980 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5f8d2632-af66-482b-82c8-3fb600084343 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.182669 Aug 31 12:55:53.648571 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1479/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:53 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:54.670423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:54.671733 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:54.680292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:54.680924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:54.681499 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:54.682327 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:54.682884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:54.683532 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:54.882038 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:54.894524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-81b973bb-6db9-4f49-92c5-4b8f32277384 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.228278 Aug 31 12:55:54.895704 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1490/2969] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:54 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:55.921651 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:55.922727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:55.931876 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:55.932534 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:55.933105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:55.934031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:55.934618 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:55.935169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:56.167511 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:56.179100 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a45f9f7b-3dfc-4168-bcae-27968b9b1b3d tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.264159 Aug 31 12:55:56.180094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1480/2970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:55 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:57.206511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:57.207654 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:57.212206 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=38 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:55:57.222998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:57.224112 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:57.225225 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:57.226771 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:57.227660 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:57.228538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:57.475392 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:57.488956 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a3626773-ba86-4212-b1a5-fc70b2ad7146 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.290294 Aug 31 12:55:57.489894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1491/2971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:57 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:58.521007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:58.521708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:58.529322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:58.529813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:58.530240 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:58.530950 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:58.531436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:58.531856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:58.696956 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:58.711407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33c98937-15f8-400f-8b0f-3011049122bc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1723 microversion: 2.1 time: 0.193892 Aug 31 12:55:58.712572 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1481/2972] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:58 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:55:59.745371 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:55:59.746019 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:55:59.754989 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:59.755526 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:59.755968 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:59.756700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:55:59.757159 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:55:59.757587 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:55:59.968730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:55:59.979539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-314d9c20-95ab-4a5b-ba66-3a994f932f45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1700 microversion: 2.1 time: 0.238402 Aug 31 12:55:59.980297 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1492/2973] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:55:59 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1700 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:00.001763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e0d41cec-a89b-45e2-ae70-2453a08bbeb1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:56:00.009864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0d41cec-a89b-45e2-ae70-2453a08bbeb1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:00.010353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0d41cec-a89b-45e2-ae70-2453a08bbeb1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:00.010792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0d41cec-a89b-45e2-ae70-2453a08bbeb1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:00.077417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e0d41cec-a89b-45e2-ae70-2453a08bbeb1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Going to try to start instance {{(pid=120572) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 12:56:00.129450 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e0d41cec-a89b-45e2-ae70-2453a08bbeb1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action" status: 202 len: 0 microversion: 2.1 time: 0.131988 Aug 31 12:56:00.130066 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1482/2974] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:55:59 2022] POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:56:00.140478 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:00.141367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:00.148320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:00.148889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:00.149361 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:00.150078 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:00.150537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:00.150967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:00.327866 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:00.341939 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-57a6701a-4d83-461c-9bc5-7e40ed7b5ff1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1709 microversion: 2.1 time: 0.204969 Aug 31 12:56:00.342934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1493/2975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:00 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1709 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:01.376322 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:01.377182 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:01.384580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:01.385095 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:01.385541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:01.386284 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:01.386750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:01.387165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:01.545739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:01.555397 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57e2d111-175e-45dd-94e4-9cb3107f6ff8 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1709 microversion: 2.1 time: 0.184557 Aug 31 12:56:01.555991 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1483/2976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:01 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:02.577851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:02.578466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:02.586586 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:02.587080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:02.587550 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:02.588260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:02.588713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:02.589138 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:02.773214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:02.785389 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ec1c9477-bcd3-4e44-9634-47e508a18865 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1713 microversion: 2.1 time: 0.211310 Aug 31 12:56:02.785985 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1494/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:02 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1713 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:41.096888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:41.098199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:41.100643 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=9 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:41.101455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:41.110288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:41.110828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:41.111351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:41.112185 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:41.113388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:41.113931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:41.211416 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lazy-loading 'services' on Instance uuid c6690e73-5f4a-4c80-89f4-86b6b13e85b3 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:56:41.296309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d97e8fb9-6312-4b90-9225-04b8e5d7bfb3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-volume_attachments/17e78db3-a321-4566-8fa5-d1b6347e2485" status: 202 len: 0 microversion: 2.1 time: 0.203808 Aug 31 12:56:41.297156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1484/2978] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:56:41 2022] DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-volume_attachments/17e78db3-a321-4566-8fa5-d1b6347e2485 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:56:42.447919 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cabf323-00be-49ba-8059-3f501a9b3334 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:56:42.450590 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=7 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:42.451441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=37 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:56:42.452417 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:56:42.452635 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 12:56:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action (ip 10.222.0.27) !!! Aug 31 12:56:42.464394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cabf323-00be-49ba-8059-3f501a9b3334 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:42.465077 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cabf323-00be-49ba-8059-3f501a9b3334 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:42.465612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cabf323-00be-49ba-8059-3f501a9b3334 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:42.494399 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cabf323-00be-49ba-8059-3f501a9b3334 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Going to try to stop instance {{(pid=120573) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 12:56:42.545591 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cabf323-00be-49ba-8059-3f501a9b3334 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action" status: 202 len: 0 microversion: 2.1 time: 0.101228 Aug 31 12:56:42.546284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1495/2979] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:56:42 2022] POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:56:42.562096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:42.563611 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:42.575954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:42.576819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:42.577597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:42.578872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:42.579735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:42.580487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:42.747417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:42.760318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d1f9eaa-d898-40f3-b3cc-fbbfe3b4cc46 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1677 microversion: 2.1 time: 0.207313 Aug 31 12:56:42.761316 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1485/2980] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:42 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:43.783828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:43.784765 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:43.792816 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:43.793460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:43.794079 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:43.794910 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:43.795509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:43.796024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:43.968097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:43.977133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5ab02969-defa-4718-b276-7b5f39827f4e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1677 microversion: 2.1 time: 0.198402 Aug 31 12:56:43.977719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1496/2981] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:43 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:45.000094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:45.000930 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:45.008705 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:45.009354 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:45.009784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:45.010475 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:45.010927 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:45.011408 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:45.167852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:45.185798 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db52addc-8d2a-4ff4-91f5-7ffd4088f48b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1677 microversion: 2.1 time: 0.189984 Aug 31 12:56:45.186867 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1486/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:44 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:46.209656 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:46.210302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:46.218850 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:46.219498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:46.219943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:46.220817 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:46.221320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:46.222007 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:46.378245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:46.386732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-638a976a-12ce-4867-b396-642cf61643fe tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1677 microversion: 2.1 time: 0.181672 Aug 31 12:56:46.387355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1497/2983] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:46 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:47.408473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:47.409410 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:47.416948 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:47.417444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:47.417878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:47.418588 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:47.419037 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:47.419502 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:47.577337 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:47.586162 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-019ac571-b31d-4b17-982c-68f994f9a58c tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1677 microversion: 2.1 time: 0.181529 Aug 31 12:56:47.586763 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1487/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:47 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:48.611291 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:48.612024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:48.619323 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:48.619826 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:48.620261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:48.621298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:48.621879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:48.622299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:48.775892 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:48.784569 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26d60882-0191-4ef6-9745-f63cbf8ee9ae tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1654 microversion: 2.1 time: 0.177552 Aug 31 12:56:48.785143 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1498/2985] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:48 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:48.806548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-94c8e4c6-7bef-4026-8b2c-89f61de8973e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:56:48.814531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94c8e4c6-7bef-4026-8b2c-89f61de8973e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:48.815001 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94c8e4c6-7bef-4026-8b2c-89f61de8973e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:48.815649 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-94c8e4c6-7bef-4026-8b2c-89f61de8973e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:48.841445 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-94c8e4c6-7bef-4026-8b2c-89f61de8973e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Going to try to start instance {{(pid=120572) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 12:56:48.897288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-94c8e4c6-7bef-4026-8b2c-89f61de8973e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action" status: 202 len: 0 microversion: 2.1 time: 0.094049 Aug 31 12:56:48.901886 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1488/2986] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 31 12:56:48 2022] POST /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:56:48.911467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:48.912698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:48.926763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:48.927974 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:48.928737 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:48.930009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:48.930806 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:48.931600 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:49.130853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:49.140487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-84473cce-fa05-449e-b19e-1216514383e4 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1663 microversion: 2.1 time: 0.236322 Aug 31 12:56:49.141357 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1499/2987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:48 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1663 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:50.164676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:50.165279 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:50.172994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:50.173521 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:50.174026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:50.175443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:50.176021 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:50.176496 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:50.330715 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:50.339633 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-95e69b00-732f-4d36-9fda-1cee5ef22255 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1663 microversion: 2.1 time: 0.179514 Aug 31 12:56:50.340453 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1489/2988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:50 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:56:51.375543 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:56:51.376467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:56:51.383961 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:51.384457 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:51.384897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:51.385611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:56:51.386042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:56:51.386498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:56:51.565165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:56:51.579915 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0cad339f-f3a7-4661-90bf-3044e589aae1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1667 microversion: 2.1 time: 0.208518 Aug 31 12:56:51.580960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1500/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:56:51 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1667 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:24.826708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:24.829254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:24.832133 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=12 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:24.832873 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:24.839807 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:24.840307 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:24.840868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:24.841676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:24.842150 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:24.842595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:24.879282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3408605-798b-416d-bdc3-722732026103 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056577 Aug 31 12:57:24.882730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1490/2990] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:57:24 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:57:24.953772 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:24.954700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:24.957355 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=12 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:24.958280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:24.967861 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:24.968629 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:24.969238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:24.970306 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:24.970908 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:24.971549 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:25.006080 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:57:25.104381 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-668f6a32-7462-4568-8937-3dfbdc7dda59 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 204 len: 0 microversion: 2.1 time: 0.154926 Aug 31 12:57:25.105241 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1501/2991] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:57:24 2022] DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:57:25.115099 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:25.116219 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:25.125228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:25.125750 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:25.126250 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:25.126994 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:25.127548 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:25.127979 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:25.285509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:25.294130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a741c8b4-0771-44d5-89ff-aa1b539add23 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1673 microversion: 2.1 time: 0.184335 Aug 31 12:57:25.294703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1491/2992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:25 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:26.322099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:26.323452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:26.334394 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:26.335165 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:26.335909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:26.337085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:26.337588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:26.338017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:26.489813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:26.498643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba7051c0-ca4c-4241-8a34-4bb25df6ea93 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1673 microversion: 2.1 time: 0.184997 Aug 31 12:57:26.499249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1502/2993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:26 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:27.520977 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:27.521586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:27.529938 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:27.530944 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:27.531332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:27.532476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:27.533118 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:27.533631 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:27.724573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:27.737995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-128a6a68-da78-4391-9845-a33ee4380c76 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1673 microversion: 2.1 time: 0.221085 Aug 31 12:57:27.739186 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1492/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:27 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:28.763789 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:28.764760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:28.774127 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:28.774803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:28.775425 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:28.776294 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:28.776880 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:28.777405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:28.872227 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:28.888243 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f1d3b34f-4615-475e-a60c-1a10ead59474 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 200 len: 1605 microversion: 2.1 time: 0.129072 Aug 31 12:57:28.890331 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1503/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:28 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 1605 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:28.923174 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-a81e1f8a-9a3d-43c2-8b9f-b68e73bf978d req-9038ab4d-36f0-4aa9-aa29-fb4218d5a29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6690e73-5f4a-4c80-89f4-86b6b13e85b3", "name": "network-vif-deleted", "tag": "9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:28.935084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a81e1f8a-9a3d-43c2-8b9f-b68e73bf978d req-9038ab4d-36f0-4aa9-aa29-fb4218d5a29c service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:28.935614 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a81e1f8a-9a3d-43c2-8b9f-b68e73bf978d req-9038ab4d-36f0-4aa9-aa29-fb4218d5a29c service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:28.936043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a81e1f8a-9a3d-43c2-8b9f-b68e73bf978d req-9038ab4d-36f0-4aa9-aa29-fb4218d5a29c service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:28.955581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-a81e1f8a-9a3d-43c2-8b9f-b68e73bf978d req-9038ab4d-36f0-4aa9-aa29-fb4218d5a29c service nova] Creating event network-vif-deleted:9c13a7b7-de2a-4484-9f6e-ffa7c43d32e3 for instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 on hv-cinder-85535 Aug 31 12:57:28.966389 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-a81e1f8a-9a3d-43c2-8b9f-b68e73bf978d req-9038ab4d-36f0-4aa9-aa29-fb4218d5a29c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046820 Aug 31 12:57:28.967381 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1493/2996] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:29.928710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:29.929944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:29.942211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:29.943055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:29.943891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:29.945164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:29.945998 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:29.946759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:29.975014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] HTTP exception thrown: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Request method failure captured: Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 HTTP/1.1 Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1n8T7Pr2Pker1CafSEPAIyLMs2nxKurC6CR1-xVMYcUts_mr3rP_G-fvlhZFI7xt5rbxzbGmuOn49tYjRsfddmM_g60Of4Uldb2xEIMzIO0OL7ix7kMrt3OsENl_BSXSCiuYZXDU8e0Zh0IoC6vTdl2kC9Bp600fe9wK_N66WQg-Eg Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:57:29.978467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23ff9f71e16d460781dd5889d784b4a3", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 454a193b26684746bc8c9278a1f1f175 Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:57:29.981023 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'c6690e73-5f4a-4c80-89f4-86b6b13e85b3'} Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:57:29.982460 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:57:29.984851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:57:29.987033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Returning 404 to user: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:57:29.987033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b765e4d6-f35c-4b38-9d1c-d8f2c8789ebc tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 404 len: 111 microversion: 2.1 time: 0.059897 Aug 31 12:57:29.987033 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1504/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:29 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:57:29.996368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0052882c-49e8-4dce-bf18-a8cb55d7f086 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '.version_select at 0x7fe854f31f70>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:30.004808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0052882c-49e8-4dce-bf18-a8cb55d7f086 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [9efae9f8-83eb-4b34-a929-232d5a8c7a7d] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:57:31.014101 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [None req-0052882c-49e8-4dce-bf18-a8cb55d7f086 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [9efae9f8-83eb-4b34-a929-232d5a8c7a7d] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44392. Aug 31 12:57:31.038119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0052882c-49e8-4dce-bf18-a8cb55d7f086 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-546931997" status: 202 len: 0 microversion: 2.1 time: 1.048236 Aug 31 12:57:31.038981 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1494/2998] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 31 12:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-546931997 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:57:32.055951 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5bfd8a2b-daec-4f82-b937-08e3a0debf67 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: .version_select at 0x7fe858686dc0>, body: {"keypair": {"name": "tempest-keypair-643114639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL4wfCnqHd0L659Ki7fvSRogO/QFK5rgU1PsOmi1cGH9M+YtpJ7bjl52CziLbyKBb5bcS/VsZILeqqeJS4zbormNXPFJ/5uXTlv3SScW8mi/HEKfYVSvhgd8P0CAVz/DQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:32.075030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5bfd8a2b-daec-4f82-b937-08e3a0debf67 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:57:32.079496 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5bfd8a2b-daec-4f82-b937-08e3a0debf67 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for user 454a193b26684746bc8c9278a1f1f175 and project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:57:32.111061 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5bfd8a2b-daec-4f82-b937-08e3a0debf67 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059322 Aug 31 12:57:32.111719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1505/2999] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 31 12:57:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:33.771952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-137122160", "imageRef": "aa4c9913-3683-4425-9683-dc1a269e208f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3af97f7-319b-4870-a914-820da543cdbb"}], "security_groups": [{"name": "tempest-securitygroup--356652214"}], "key_name": "tempest-keypair-643114639", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:33.896639 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] validate_networks() for [('a3af97f7-319b-4870-a914-820da543cdbb', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:57:34.351164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:57:34.351629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:57:34.352125 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:57:34.352601 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:57:34.353059 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:57:34.363276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:34.363881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:34.364224 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:34.364972 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:34.365433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:34.365859 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:34.386299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:57:34.391812 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Getting quotas for user 454a193b26684746bc8c9278a1f1f175 and project 23ff9f71e16d460781dd5889d784b4a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:57:34.405908 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:57:34.408311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa4c9913-3683-4425-9683-dc1a269e208f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:57:34.484739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-651983ad-87be-46c3-b18b-8ce4ab4de1c6 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.717728 Aug 31 12:57:34.485513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1495/3000] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:57:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:57:34.497760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23641cd7-859b-47e6-8ac6-ea392297620b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:34.498617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-23641cd7-859b-47e6-8ac6-ea392297620b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:34.564312 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-23641cd7-859b-47e6-8ac6-ea392297620b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:34.572966 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-23641cd7-859b-47e6-8ac6-ea392297620b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1236 microversion: 2.1 time: 0.079932 Aug 31 12:57:34.573557 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1506/3001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:34 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:35.595248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:35.595844 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:35.602762 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:35.603288 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:35.603724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:35.604431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:35.604881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:35.605312 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:35.674169 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:35.684429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6edd46d4-ea40-438a-9ea4-491c4242e67f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1288 microversion: 2.1 time: 0.093563 Aug 31 12:57:35.686877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1496/3002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:35 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:36.711210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:36.712332 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:36.724183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:36.725042 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:36.725682 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:36.726473 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:36.727016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:36.727480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:36.933179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:36.946981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cc875cde-91d6-4f56-8c30-f779e387c23e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1361 microversion: 2.1 time: 0.243744 Aug 31 12:57:36.947762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1507/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:36 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:37.251509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-5faf3eb0-d972-49ed-8d5d-54ce9a5af4cf req-e724500f-be65-4c03-b9f3-a4f8e7f0d0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00814a8c-202c-481e-926e-9a4199c8182c", "tag": "8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:37.270790 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5faf3eb0-d972-49ed-8d5d-54ce9a5af4cf req-e724500f-be65-4c03-b9f3-a4f8e7f0d0a8 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:37.271787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5faf3eb0-d972-49ed-8d5d-54ce9a5af4cf req-e724500f-be65-4c03-b9f3-a4f8e7f0d0a8 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:37.272668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5faf3eb0-d972-49ed-8d5d-54ce9a5af4cf req-e724500f-be65-4c03-b9f3-a4f8e7f0d0a8 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:37.291006 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-5faf3eb0-d972-49ed-8d5d-54ce9a5af4cf req-e724500f-be65-4c03-b9f3-a4f8e7f0d0a8 service nova] Creating event network-changed:8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4 for instance 00814a8c-202c-481e-926e-9a4199c8182c on hv-cinder-85535 Aug 31 12:57:37.296813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-5faf3eb0-d972-49ed-8d5d-54ce9a5af4cf req-e724500f-be65-4c03-b9f3-a4f8e7f0d0a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053368 Aug 31 12:57:37.297718 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1497/3004] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:37.969531 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:37.970188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:37.977403 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:37.978136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:37.978700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:37.979609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:37.980093 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:37.980621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:38.134213 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:38.143563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e6ac3ab8-77db-4f79-86df-42a7535ddb0a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1361 microversion: 2.1 time: 0.177446 Aug 31 12:57:38.144238 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1508/3005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:37 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:39.170597 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:39.171523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:39.181996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:39.182785 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:39.183434 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:39.184486 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:39.185211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:39.185878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:39.345414 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:39.358754 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d576c2d-4cfd-48ff-966d-2ac415fae4e0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1361 microversion: 2.1 time: 0.195714 Aug 31 12:57:39.359858 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1498/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:39 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:40.397278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:40.398100 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:40.408272 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:40.409168 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:40.409991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:40.411461 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:40.412328 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:40.413109 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:40.601854 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:40.610490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de07c142-526c-4711-9d07-a7239ba10c77 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1361 microversion: 2.1 time: 0.219543 Aug 31 12:57:40.611210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1509/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:40 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:41.634688 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:41.635324 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:41.642573 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:41.643104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:41.643596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:41.644485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:41.644997 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:41.645423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:41.798530 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:41.813315 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b26256d5-2780-40d0-b41c-2fd84b9fcb0b tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1361 microversion: 2.1 time: 0.182551 Aug 31 12:57:41.814374 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1499/3008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:41 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:42.127209 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-0ec088bd-3876-4873-8e84-dfce022c648a req-25ffe0d4-a5ec-4608-a4d7-dd77fa48782c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00814a8c-202c-481e-926e-9a4199c8182c", "name": "network-vif-plugged", "status": "completed", "tag": "8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:42.141065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-0ec088bd-3876-4873-8e84-dfce022c648a req-25ffe0d4-a5ec-4608-a4d7-dd77fa48782c service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:42.141788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-0ec088bd-3876-4873-8e84-dfce022c648a req-25ffe0d4-a5ec-4608-a4d7-dd77fa48782c service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:42.142697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-0ec088bd-3876-4873-8e84-dfce022c648a req-25ffe0d4-a5ec-4608-a4d7-dd77fa48782c service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:42.159857 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-0ec088bd-3876-4873-8e84-dfce022c648a req-25ffe0d4-a5ec-4608-a4d7-dd77fa48782c service nova] Creating event network-vif-plugged:8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4 for instance 00814a8c-202c-481e-926e-9a4199c8182c on hv-cinder-85535 Aug 31 12:57:42.165621 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-0ec088bd-3876-4873-8e84-dfce022c648a req-25ffe0d4-a5ec-4608-a4d7-dd77fa48782c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043202 Aug 31 12:57:42.166254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1510/3009] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:42.849405 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:42.850050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:42.857399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:42.857890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:42.858323 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:42.859020 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:42.859514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:42.859911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:43.029959 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:43.039727 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bfe63a2f-c229-4bdb-abdd-b9e40d7d60ee tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1361 microversion: 2.1 time: 0.194521 Aug 31 12:57:43.040294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1500/3010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:42 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:44.065872 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:44.066594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:44.073712 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:44.074207 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:44.074667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:44.075412 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:44.075868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:44.076289 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:44.231465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:44.240233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a00fab16-ee73-4c90-8ac5-9aed0d51d98a tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1546 microversion: 2.1 time: 0.179398 Aug 31 12:57:44.240808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1511/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:44 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:44.261703 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:44.262333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:44.269869 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:44.270400 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:44.270845 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:44.271603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:44.272060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:44.272487 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:44.354425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3c14ea99-23d1-443f-9fcb-e44439061371 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096711 Aug 31 12:57:44.355043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1501/3012] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 31 12:57:44 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:45.546571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-06ec4955-13a3-4b0c-9b73-15eb18581c6e req-e7a0edba-bdd0-4e85-95d5-c2d01f9b71c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00814a8c-202c-481e-926e-9a4199c8182c", "tag": "8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:45.552775 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:45.560547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-06ec4955-13a3-4b0c-9b73-15eb18581c6e req-e7a0edba-bdd0-4e85-95d5-c2d01f9b71c2 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:45.561133 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-06ec4955-13a3-4b0c-9b73-15eb18581c6e req-e7a0edba-bdd0-4e85-95d5-c2d01f9b71c2 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:45.561537 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-06ec4955-13a3-4b0c-9b73-15eb18581c6e req-e7a0edba-bdd0-4e85-95d5-c2d01f9b71c2 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:45.574583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-06ec4955-13a3-4b0c-9b73-15eb18581c6e req-e7a0edba-bdd0-4e85-95d5-c2d01f9b71c2 service nova] Creating event network-changed:8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4 for instance 00814a8c-202c-481e-926e-9a4199c8182c on hv-cinder-85535 Aug 31 12:57:45.580886 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-06ec4955-13a3-4b0c-9b73-15eb18581c6e req-e7a0edba-bdd0-4e85-95d5-c2d01f9b71c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038012 Aug 31 12:57:45.581988 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1512/3013] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:57:50.040976 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:50.041774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:50.047122 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:50.047752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:50.055341 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:50.055834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:50.056273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:50.057007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:50.057460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:50.057881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:50.087348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:57:50.179029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f89a5b3-16a3-4213-ac41-6f3009c575e2 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "DELETE /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 204 len: 0 microversion: 2.1 time: 0.138445 Aug 31 12:57:50.179699 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1502/3014] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:57:50 2022] DELETE /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:57:50.195941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:50.197090 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:50.207962 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:50.208762 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:50.209510 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:50.210688 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:50.211439 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:50.212211 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:50.379015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:50.387924 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8a14459-69e9-4935-adfa-2f615b38129d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1576 microversion: 2.1 time: 0.201091 Aug 31 12:57:50.388541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1513/3015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:50 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:51.415755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:51.416752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:51.426654 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:51.427176 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:51.427680 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:51.428448 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:51.428906 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:51.429332 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:51.595743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:51.605278 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1c864184-d7bc-4a54-a03d-716b469cfbcb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1576 microversion: 2.1 time: 0.197986 Aug 31 12:57:51.605966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1503/3016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:51 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:52.631125 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:52.631913 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:52.646509 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:52.647382 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:52.648150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:52.649393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:52.650195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:52.651070 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:52.740117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:52.748949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a18ad25-a3dc-4e00-b043-276aae29d02e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1510 microversion: 2.1 time: 0.124121 Aug 31 12:57:52.753270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1514/3017] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:52 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1510 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:57:52.976484 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-426fc5a9-f741-41e3-9db2-aeeb71b2b4aa req-03f4ad44-a5ce-4446-bd67-a79908b72d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488801fc-4be4-4482-ac14-1c9b60f77a15", "name": "network-vif-deleted", "tag": "2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:53.000692 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-426fc5a9-f741-41e3-9db2-aeeb71b2b4aa req-03f4ad44-a5ce-4446-bd67-a79908b72d83 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:53.002302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-426fc5a9-f741-41e3-9db2-aeeb71b2b4aa req-03f4ad44-a5ce-4446-bd67-a79908b72d83 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:53.003619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-426fc5a9-f741-41e3-9db2-aeeb71b2b4aa req-03f4ad44-a5ce-4446-bd67-a79908b72d83 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:53.028863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-426fc5a9-f741-41e3-9db2-aeeb71b2b4aa req-03f4ad44-a5ce-4446-bd67-a79908b72d83 service nova] Creating event network-vif-deleted:2d0a5843-ccdf-47c7-a8d4-773f3c9a28c0 for instance 488801fc-4be4-4482-ac14-1c9b60f77a15 on hv-cinder-85535 Aug 31 12:57:53.039724 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-426fc5a9-f741-41e3-9db2-aeeb71b2b4aa req-03f4ad44-a5ce-4446-bd67-a79908b72d83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075550 Aug 31 12:57:53.040813 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1504/3018] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:57:53.775120 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:53.782153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:53.789565 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:53.790068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:53.790513 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:53.791269 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:53.791926 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:53.792360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:53.829330 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:53.829690 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:53.830185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:53.830534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lazy-loading 'fault' on Instance uuid 488801fc-4be4-4482-ac14-1c9b60f77a15 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:57:53.904581 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:53.920855 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eddb4f16-b727-4ea1-8c71-853b54a78c27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 200 len: 1231 microversion: 2.1 time: 0.153553 Aug 31 12:57:53.933101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1515/3019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:53 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 1231 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:54.944505 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:54.945382 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:54.947852 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:54.955726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:54.956314 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:54.956811 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:54.957562 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:54.958097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:54.958598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:54.962373 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:54.978536 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] HTTP exception thrown: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Request method failure captured: Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 HTTP/1.1 Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1ogemiuO9ewAHqTQjX3ajmOJztff8DA3C8mYX_GudCMYuyy85F8Io0itOZ2bg-sghhS7tWNkfL4npVIwfjcJRCiKy-fTfGywFDOiObUo-hRV0FNX4RPwK7qLtshby70wX-qIBQcly6M2ZP3tGAxhaFGajp4VT352ZJGcl_Lbjcw50U Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:57:54.980449 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b5e2d3e145e04936bf60fe93b5011cc2", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-871905966 Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-871905966-project Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 171b9c24597545a1a5c8388849ef5819 Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-871905966-project Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 12:57:54.982866 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '488801fc-4be4-4482-ac14-1c9b60f77a15'} Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:57:54.984298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 12:57:54.986523 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:57:54.988527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Returning 404 to user: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:57:54.988527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28350ad4-8da2-486b-8e85-fed23c6f22d5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 404 len: 111 microversion: 2.1 time: 0.042291 Aug 31 12:57:54.988527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1505/3020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:54 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:57:55.122579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-373085953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1853732473", "security_groups": [{"name": "tempest-secgroup-smoke-91613680"}], "block_device_mapping_v2": [{"uuid": "dd5d1c15-04f5-4fcb-93f8-2546262b8eb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd3933ce-2f4d-4c14-bacd-fbfaa9c0ca4b"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:57:55.135636 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:55.269278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] validate_networks() for [('dd3933ce-2f4d-4c14-bacd-fbfaa9c0ca4b', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:57:55.758630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:57:55.759146 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:57:55.759700 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:57:55.760148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:57:55.760604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:57:55.771612 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:55.772105 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:55.772558 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:55.773298 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:55.773756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:55.774189 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:55.780848 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:57:55.798097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:57:55.804471 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for user 171b9c24597545a1a5c8388849ef5819 and project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:57:55.872646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:57:55.875617 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd5d1c15-04f5-4fcb-93f8-2546262b8eb0',volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:57:56.041475 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b4911cee-ddd6-414e-b560-7ab0a3fe1513 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.922702 Aug 31 12:57:56.042040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1516/3021] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 12:57:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:57:56.057832 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a88a409e-4fbc-454c-a5f2-1eb23de8954a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:56.058988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a88a409e-4fbc-454c-a5f2-1eb23de8954a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:56.122513 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a88a409e-4fbc-454c-a5f2-1eb23de8954a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:56.130853 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a88a409e-4fbc-454c-a5f2-1eb23de8954a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1094 microversion: 2.1 time: 0.077300 Aug 31 12:57:56.131587 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1506/3022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:56 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:57.153891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f515e100-5a1c-4dc1-8d80-1a910de7e3b4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:57.154933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f515e100-5a1c-4dc1-8d80-1a910de7e3b4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:57.225448 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f515e100-5a1c-4dc1-8d80-1a910de7e3b4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:57.232840 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f515e100-5a1c-4dc1-8d80-1a910de7e3b4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1094 microversion: 2.1 time: 0.084167 Aug 31 12:57:57.233415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1517/3023] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:57 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:58.255998 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-39ed12cb-48a3-42f5-91a2-63b7846a066f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:58.256854 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-39ed12cb-48a3-42f5-91a2-63b7846a066f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:58.322179 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-39ed12cb-48a3-42f5-91a2-63b7846a066f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:58.335596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-39ed12cb-48a3-42f5-91a2-63b7846a066f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1094 microversion: 2.1 time: 0.084547 Aug 31 12:57:58.336368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1507/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:58 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:57:59.358451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:57:59.359085 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:57:59.368351 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:59.369065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:59.369500 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:59.370420 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:57:59.370934 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:57:59.371390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:57:59.445580 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:57:59.454579 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41c2a986-4f5c-440e-9237-5ea8fb1f1c7b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1210 microversion: 2.1 time: 0.100248 Aug 31 12:57:59.455182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1518/3025] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:57:59 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:00.486437 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:00.487220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:00.497024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:00.497848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:00.498828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:00.499758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:00.500526 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:00.501283 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:00.659277 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:00.668254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7c1184b1-e2c9-441c-bab8-61435c67b912 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.186798 Aug 31 12:58:00.668914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1508/3026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:00 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:58:01.025084 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-26ea62f2-5d82-4bb8-b5cd-cb5ca5583211 req-fede5915-9a93-45db-954a-1fc63a1ea9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e9aa1f-7e21-43c8-91d1-fa5a0c682cad", "tag": "a330fdf1-aad4-47a5-ae8e-263e7d6abb4d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:01.039102 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-26ea62f2-5d82-4bb8-b5cd-cb5ca5583211 req-fede5915-9a93-45db-954a-1fc63a1ea9e0 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:01.039721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-26ea62f2-5d82-4bb8-b5cd-cb5ca5583211 req-fede5915-9a93-45db-954a-1fc63a1ea9e0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:01.040254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-26ea62f2-5d82-4bb8-b5cd-cb5ca5583211 req-fede5915-9a93-45db-954a-1fc63a1ea9e0 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:01.054673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-26ea62f2-5d82-4bb8-b5cd-cb5ca5583211 req-fede5915-9a93-45db-954a-1fc63a1ea9e0 service nova] Creating event network-changed:a330fdf1-aad4-47a5-ae8e-263e7d6abb4d for instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad on hv-cinder-85535 Aug 31 12:58:01.060664 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-26ea62f2-5d82-4bb8-b5cd-cb5ca5583211 req-fede5915-9a93-45db-954a-1fc63a1ea9e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045957 Aug 31 12:58:01.061283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1519/3027] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:01.700048 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:01.701127 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:01.708343 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:01.709264 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:01.709710 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:01.710417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:01.710870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:01.711290 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:01.907792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:01.918594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-780f7783-d9c8-4969-93ce-d0535b270caa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.222714 Aug 31 12:58:01.919490 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1509/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:01 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:02.947474 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:02.948179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:02.955787 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:02.956287 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:02.956811 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:02.957804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:02.958002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:02.958490 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:03.107284 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:03.115822 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcb48148-433d-4521-870b-7540f7578ae1 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.173125 Aug 31 12:58:03.116393 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1520/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:02 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:04.141940 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:04.143060 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:04.155492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:04.156273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:04.157050 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:04.158313 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:04.159078 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:04.160439 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:04.342390 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:04.351303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb50d0d1-1ade-41b8-a900-8321c186c461 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.216376 Aug 31 12:58:04.351912 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1510/3030] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:04 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:05.372838 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:05.374265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:05.381673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:05.382164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:05.382604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:05.384045 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:05.384536 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:05.384965 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:05.544710 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:05.553648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d99fa62-9d9b-4056-8f7d-68b014c5dba6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.184711 Aug 31 12:58:05.554254 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1521/3031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:05 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:06.576058 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:06.576792 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:06.583989 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:06.584468 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:06.584918 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:06.585627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:06.586064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:06.586479 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:06.741517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:06.750742 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c507cb6-6974-4a1e-916e-da6befa5c3fc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.178612 Aug 31 12:58:06.751353 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1511/3032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:06 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:07.773508 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:07.774215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:07.776307 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:07.777732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:07.784480 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:07.785099 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:07.785534 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:07.786244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:07.786680 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:07.787113 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:07.951365 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:07.961002 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6893be99-c997-4002-97ec-2313b58b866a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.191954 Aug 31 12:58:07.961594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1522/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:07 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:08.985772 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:08.986518 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:08.989500 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:08.995856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:08.996328 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:08.996795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:08.997538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:08.997996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:08.998419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:09.147888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:09.156205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d54d16e5-7e7a-4b6b-91fa-cbf761b4cc00 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.176866 Aug 31 12:58:09.156797 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1512/3034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:08 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:10.188142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:10.189157 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:10.197763 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:10.198250 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:10.198679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:10.199418 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:10.199868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:10.200280 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:10.380751 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:10.390736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91706c7c-351c-42ce-abe5-2783d55d266a tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.207137 Aug 31 12:58:10.391405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1523/3035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:10 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:11.413914 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:11.415004 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:11.426051 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:11.426707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:11.427298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:11.428242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:11.428835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:11.429444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:11.597871 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:11.610346 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1459d22d-b35d-4aeb-a166-64eb55bb2516 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.200969 Aug 31 12:58:11.611249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1513/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:11 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:12.205516 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d3e2f4ba-efa0-4929-9a3d-ce694d94b427 req-dcaf12f3-e62a-4b59-8071-8d7f538cddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e9aa1f-7e21-43c8-91d1-fa5a0c682cad", "name": "network-vif-plugged", "status": "completed", "tag": "a330fdf1-aad4-47a5-ae8e-263e7d6abb4d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:12.220290 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d3e2f4ba-efa0-4929-9a3d-ce694d94b427 req-dcaf12f3-e62a-4b59-8071-8d7f538cddc7 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:12.221137 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d3e2f4ba-efa0-4929-9a3d-ce694d94b427 req-dcaf12f3-e62a-4b59-8071-8d7f538cddc7 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:12.221868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d3e2f4ba-efa0-4929-9a3d-ce694d94b427 req-dcaf12f3-e62a-4b59-8071-8d7f538cddc7 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:12.238573 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d3e2f4ba-efa0-4929-9a3d-ce694d94b427 req-dcaf12f3-e62a-4b59-8071-8d7f538cddc7 service nova] Creating event network-vif-plugged:a330fdf1-aad4-47a5-ae8e-263e7d6abb4d for instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad on hv-cinder-85535 Aug 31 12:58:12.244868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d3e2f4ba-efa0-4929-9a3d-ce694d94b427 req-dcaf12f3-e62a-4b59-8071-8d7f538cddc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043465 Aug 31 12:58:12.246010 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1524/3037] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:12.647255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:12.647971 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:12.657268 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:12.658094 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:12.658619 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:12.659661 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:12.660170 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:12.660602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:12.833532 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:12.842262 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-05a6bbad-6314-401c-9cd9-b0b9bdfd29d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.200314 Aug 31 12:58:12.842890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1514/3038] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:12 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:13.865489 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:13.866220 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:13.873136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:13.873625 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:13.874363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:13.875082 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:13.875560 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:13.875987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:14.043465 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:14.052699 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f363916-d8ea-4b0f-8084-03b308c1464d tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1264 microversion: 2.1 time: 0.192340 Aug 31 12:58:14.053378 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1525/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:13 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:15.074326 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:15.075165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:15.082351 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:15.083149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:15.083855 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:15.084681 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:15.085233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:15.085743 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:15.239901 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:15.249596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0293999c-985f-4497-bd0d-c4cf916bdc83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1451 microversion: 2.1 time: 0.178834 Aug 31 12:58:15.250195 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1515/3040] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:15 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:15.270852 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:15.271916 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:15.283594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:15.284451 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:15.285293 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:15.286407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:15.286941 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:15.287810 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:15.464923 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:15.474116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-39d36e36-148e-48fa-b8c8-227336078e68 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1451 microversion: 2.1 time: 0.207455 Aug 31 12:58:15.474769 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1526/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:15 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1451 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:58:17.384964 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-fae46d00-7675-43c4-84fd-4b0712d01532 req-1c73f934-348b-4ab8-a47c-ec1530f0618b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e9aa1f-7e21-43c8-91d1-fa5a0c682cad", "tag": "a330fdf1-aad4-47a5-ae8e-263e7d6abb4d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:17.399031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-fae46d00-7675-43c4-84fd-4b0712d01532 req-1c73f934-348b-4ab8-a47c-ec1530f0618b service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:17.399698 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-fae46d00-7675-43c4-84fd-4b0712d01532 req-1c73f934-348b-4ab8-a47c-ec1530f0618b service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:17.400227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-fae46d00-7675-43c4-84fd-4b0712d01532 req-1c73f934-348b-4ab8-a47c-ec1530f0618b service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:17.414233 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-fae46d00-7675-43c4-84fd-4b0712d01532 req-1c73f934-348b-4ab8-a47c-ec1530f0618b service nova] Creating event network-changed:a330fdf1-aad4-47a5-ae8e-263e7d6abb4d for instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad on hv-cinder-85535 Aug 31 12:58:17.419963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-fae46d00-7675-43c4-84fd-4b0712d01532 req-1c73f934-348b-4ab8-a47c-ec1530f0618b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039021 Aug 31 12:58:17.420794 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1516/3042] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:21.896419 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:21.897018 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:21.904322 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:21.904829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:21.905267 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:21.906008 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:21.906454 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:21.906881 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:21.934773 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-302dd692-3082-4a0d-b245-f2a09783986e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/ips" status: 200 len: 145 microversion: 2.1 time: 0.042591 Aug 31 12:58:21.935406 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1527/3043] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:58:21 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:23.424016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71a71d3d-79f0-4382-956b-4b3ced6d7356"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:23.426733 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:23.433803 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:23.434333 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:23.434868 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:23.435676 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:23.436431 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:23.436960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:23.732894 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a925270c-9cef-4daf-ac10-122fd6844ef0 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314403 Aug 31 12:58:23.733538 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1517/3044] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:58:23 2022] POST /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:31.445933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:31.449713 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:31.454270 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:31.464942 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:31.465804 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:31.466596 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:31.467902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:31.468717 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:31.469498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:31.474776 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=52 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:31.508009 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41850d80-9d85-4eb6-bf42-459ab0936149 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070451 Aug 31 12:58:31.508594 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1528/3045] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:58:31 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:31.523744 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:31.524311 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:31.527019 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=30 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:31.534265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:31.534755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:31.535303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:31.536028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:31.536472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:31.536888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:31.539752 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:58:31.574007 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f5dbb46-41d1-47db-97f2-47d6da2c2407 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/71a71d3d-79f0-4382-956b-4b3ced6d7356" status: 200 len: 194 microversion: 2.1 time: 0.054909 Aug 31 12:58:31.574545 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1518/3046] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 31 12:58:31 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/71a71d3d-79f0-4382-956b-4b3ced6d7356 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:33.028427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2019f8e-f1c7-4ccc-ba7a-8a689f4903b6"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:33.030868 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:33.038649 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:33.039141 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:33.039620 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:33.040343 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:33.040851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:33.041215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:33.341902 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-79322c64-8f80-4096-8727-f99e99c4fec3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "POST /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317275 Aug 31 12:58:33.343150 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1529/3047] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 31 12:58:33 2022] POST /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:58:41.016781 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:41.020464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:41.030440 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:41.031269 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:41.032061 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:41.033263 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:41.034043 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:41.034796 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:41.075875 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-000dee29-4ca8-4ba6-90a0-dc6ccac65e58 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066000 Aug 31 12:58:41.076549 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1519/3048] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:58:41 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:41.222506 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:41.224101 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:41.231446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:41.232067 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:41.232603 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:41.233408 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:41.233903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:41.234367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:41.269055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-db98a4d0-bccf-44cb-a25c-eff2954bfd14 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/71a71d3d-79f0-4382-956b-4b3ced6d7356" status: 200 len: 194 microversion: 2.1 time: 0.051278 Aug 31 12:58:41.269667 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1530/3049] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 31 12:58:41 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/71a71d3d-79f0-4382-956b-4b3ced6d7356 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:41.282951 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:41.283596 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:41.291158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:41.291809 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:41.292338 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:41.293137 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:41.293726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:41.294301 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:41.395605 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lazy-loading 'services' on Instance uuid 00814a8c-202c-481e-926e-9a4199c8182c {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:58:41.501472 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dee796e9-4217-42d3-be43-84354dd40a31 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/71a71d3d-79f0-4382-956b-4b3ced6d7356" status: 202 len: 0 microversion: 2.1 time: 0.224276 Aug 31 12:58:41.502541 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1520/3050] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:58:41 2022] DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/71a71d3d-79f0-4382-956b-4b3ced6d7356 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:58:42.672292 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:42.673121 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:42.684244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:42.685117 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:42.685808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:42.686778 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:42.687369 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:42.688016 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:42.742991 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cd339b0d-d8ce-43c7-ac8e-e2f52dbc5fa1 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/c2019f8e-f1c7-4ccc-ba7a-8a689f4903b6" status: 200 len: 194 microversion: 2.1 time: 0.077126 Aug 31 12:58:42.744047 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1531/3051] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 31 12:58:42 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/c2019f8e-f1c7-4ccc-ba7a-8a689f4903b6 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:42.756579 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:42.757192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:42.764318 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:42.764849 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:42.765320 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:42.766138 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:42.766629 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:42.767096 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:42.863091 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lazy-loading 'services' on Instance uuid 00814a8c-202c-481e-926e-9a4199c8182c {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:58:42.952221 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e6d9a0b-f2e3-43fc-ab30-d289407650e2 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/c2019f8e-f1c7-4ccc-ba7a-8a689f4903b6" status: 202 len: 0 microversion: 2.1 time: 0.200385 Aug 31 12:58:42.952955 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1521/3052] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 31 12:58:42 2022] DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments/c2019f8e-f1c7-4ccc-ba7a-8a689f4903b6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:58:44.167283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:44.171305 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:44.183325 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.184188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.184959 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.186178 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.186981 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.187722 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.247938 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-773ed38a-5346-4a8f-a28f-c1a345558016 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087789 Aug 31 12:58:44.248895 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1532/3053] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:58:44 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:58:44.388509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:44.390963 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:44.398563 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.399062 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.399542 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.400308 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.400765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.401194 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.436509 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-201662dc-2a39-48e3-9290-3e3168738318 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053045 Aug 31 12:58:44.437164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1522/3054] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 31 12:58:44 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 12:58:44.514222 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:44.514727 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:44.521674 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.522169 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.522609 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.523367 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.523823 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.524248 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.553011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:58:44.646572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c4b74601-f32f-40c4-8a67-2ac1a27efcf9 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 204 len: 0 microversion: 2.1 time: 0.136034 Aug 31 12:58:44.647182 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1533/3055] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:58:44 2022] DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:58:44.659016 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:44.659920 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:44.667199 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.667731 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.668242 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.668952 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:44.669469 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:44.669825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:44.827075 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:44.836835 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d82ad36-73ef-4c92-87e0-55c8900bf148 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1671 microversion: 2.1 time: 0.184485 Aug 31 12:58:44.837436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1523/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:44 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:45.860611 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:45.861303 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:45.868756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:45.869288 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:45.869723 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:45.870423 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:45.870894 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:45.871347 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:46.038415 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:46.047223 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a4b7eaf2-5e40-455a-9a25-e5f4dbf20c45 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1671 microversion: 2.1 time: 0.191848 Aug 31 12:58:46.048003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1534/3057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:45 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:47.076756 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:47.077889 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:47.089595 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:47.090443 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:47.091200 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:47.092371 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:47.093140 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:47.093878 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:47.298708 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:47.309412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d781c0f-0324-4f55-961c-760a62a03433 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1671 microversion: 2.1 time: 0.239678 Aug 31 12:58:47.310164 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1524/3058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:47 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:47.929313 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f192184f-8e2a-4e9d-9007-f96fcf3c5225 req-548f57c2-d143-429c-b277-a2c2ab540834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00814a8c-202c-481e-926e-9a4199c8182c", "name": "network-vif-deleted", "tag": "8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:47.945364 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f192184f-8e2a-4e9d-9007-f96fcf3c5225 req-548f57c2-d143-429c-b277-a2c2ab540834 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:47.946261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f192184f-8e2a-4e9d-9007-f96fcf3c5225 req-548f57c2-d143-429c-b277-a2c2ab540834 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:47.946903 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f192184f-8e2a-4e9d-9007-f96fcf3c5225 req-548f57c2-d143-429c-b277-a2c2ab540834 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:47.964149 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f192184f-8e2a-4e9d-9007-f96fcf3c5225 req-548f57c2-d143-429c-b277-a2c2ab540834 service nova] Creating event network-vif-deleted:8ccb9fbd-84cd-4ce5-a72e-2fd7f74065e4 for instance 00814a8c-202c-481e-926e-9a4199c8182c on hv-cinder-85535 Aug 31 12:58:47.973185 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f192184f-8e2a-4e9d-9007-f96fcf3c5225 req-548f57c2-d143-429c-b277-a2c2ab540834 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048542 Aug 31 12:58:47.973958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1535/3059] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 12:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:58:48.337396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:48.338097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:48.345396 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:48.345879 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:48.346294 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:48.347025 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:48.347514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:48.348531 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:48.388358 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:48.388738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:48.389184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:48.389653 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lazy-loading 'fault' on Instance uuid 00814a8c-202c-481e-926e-9a4199c8182c {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:58:48.435890 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '454a193b26684746bc8c9278a1f1f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ff9f71e16d460781dd5889d784b4a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:58:48.446996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ebd8b30b-ff8f-4e65-85dc-55d6c03d7e74 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 200 len: 1326 microversion: 2.1 time: 0.114244 Aug 31 12:58:48.447673 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1525/3060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:48 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:58:49.470245 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:49.470958 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:49.479390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:49.480014 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:49.480547 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:49.481352 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:49.481909 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:49.482427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:49.498089 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] HTTP exception thrown: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Request method failure captured: Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c HTTP/1.1 Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1n8T7Pr2Pker1CafSEPAIyLMs2nxKurC6CR1-xVMYcUts_mr3rP_G-fvlhZFI7xt5rbxzbGmuOn49tYjRsfddmM_g60Of4Uldb2xEIMzIO0OL7ix7kMrt3OsENl_BSXSCiuYZXDU8e0Zh0IoC6vTdl2kC9Bp600fe9wK_N66WQg-Eg Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:58:49.499899 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23ff9f71e16d460781dd5889d784b4a3", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 454a193b26684746bc8c9278a1f1f175 Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:49.503013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '00814a8c-202c-481e-926e-9a4199c8182c'} Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:49.504604 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:49.507204 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:49.509538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Returning 404 to user: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:49.509538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d289f47-0493-4145-a89b-10ae522733d3 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 404 len: 111 microversion: 2.1 time: 0.035835 Aug 31 12:58:49.509538 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1536/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:49 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:58:49.512517 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a5363116-2499-46eb-b771-700208a55045 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '.version_select at 0x7fe858604a60>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:49.533196 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a5363116-2499-46eb-b771-700208a55045 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643114639" status: 202 len: 0 microversion: 2.1 time: 0.025166 Aug 31 12:58:49.533784 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1526/3062] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 31 12:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643114639 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 12:58:52.620711 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:52.621320 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:52.628716 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:52.629366 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:52.630265 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:52.630631 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:52.631087 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:52.631545 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:52.649226 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] HTTP exception thrown: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Request method failure captured: Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c HTTP/1.1 Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1n8T7Pr2Pker1CafSEPAIyLMs2nxKurC6CR1-xVMYcUts_mr3rP_G-fvlhZFI7xt5rbxzbGmuOn49tYjRsfddmM_g60Of4Uldb2xEIMzIO0OL7ix7kMrt3OsENl_BSXSCiuYZXDU8e0Zh0IoC6vTdl2kC9Bp600fe9wK_N66WQg-Eg Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:58:52.651873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23ff9f71e16d460781dd5889d784b4a3", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 454a193b26684746bc8c9278a1f1f175 Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.654200 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '00814a8c-202c-481e-926e-9a4199c8182c'} Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:52.655470 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.657552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.659752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Returning 404 to user: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:52.659752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7469234c-5470-49a6-8447-b7633f435349 tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 404 len: 111 microversion: 2.1 time: 0.037822 Aug 31 12:58:52.659752 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1537/3063] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:58:52 2022] DELETE /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:58:52.667085 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:52.667870 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: 00814a8c-202c-481e-926e-9a4199c8182c] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:52.675729 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:52.676777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:52.677413 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:52.678256 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:52.678774 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:52.679273 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:52.697030 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] HTTP exception thrown: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Request method failure captured: Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c HTTP/1.1 Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1n8T7Pr2Pker1CafSEPAIyLMs2nxKurC6CR1-xVMYcUts_mr3rP_G-fvlhZFI7xt5rbxzbGmuOn49tYjRsfddmM_g60Of4Uldb2xEIMzIO0OL7ix7kMrt3OsENl_BSXSCiuYZXDU8e0Zh0IoC6vTdl2kC9Bp600fe9wK_N66WQg-Eg Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:58:52.699207 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23ff9f71e16d460781dd5889d784b4a3", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 454a193b26684746bc8c9278a1f1f175 Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.701476 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '00814a8c-202c-481e-926e-9a4199c8182c'} Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:52.703092 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. Aug 31 12:58:52.704386 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:52.705433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Returning 404 to user: Instance 00814a8c-202c-481e-926e-9a4199c8182c could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:52.705433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3ac21511-a788-46b9-95a6-46b7a5d4519e tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c" status: 404 len: 111 microversion: 2.1 time: 0.040679 Aug 31 12:58:52.705433 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1527/3064] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:52 2022] GET /compute/v2.1/servers/00814a8c-202c-481e-926e-9a4199c8182c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:58:53.868335 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:53.869244 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:53.877258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:53.877749 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:53.878186 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:53.879032 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:53.880134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:53.880134 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:53.898216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] HTTP exception thrown: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Request method failure captured: Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 HTTP/1.1 Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1n8T7Pr2Pker1CafSEPAIyLMs2nxKurC6CR1-xVMYcUts_mr3rP_G-fvlhZFI7xt5rbxzbGmuOn49tYjRsfddmM_g60Of4Uldb2xEIMzIO0OL7ix7kMrt3OsENl_BSXSCiuYZXDU8e0Zh0IoC6vTdl2kC9Bp600fe9wK_N66WQg-Eg Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:58:53.899820 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23ff9f71e16d460781dd5889d784b4a3", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 454a193b26684746bc8c9278a1f1f175 Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.902405 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'c6690e73-5f4a-4c80-89f4-86b6b13e85b3'} Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:53.903911 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.906401 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.909167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Returning 404 to user: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:53.909167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c3bf69f-c724-4fa7-975d-48e52697836f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 404 len: 111 microversion: 2.1 time: 0.038252 Aug 31 12:58:53.909167 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1538/3065] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 12:58:53 2022] DELETE /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:58:53.914110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:53.914791 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] [instance: c6690e73-5f4a-4c80-89f4-86b6b13e85b3] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:58:53.923023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:53.923877 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:53.924321 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:53.925024 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:58:53.925492 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:58:53.926076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:58:53.942227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] HTTP exception thrown: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Request method failure captured: Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 HTTP/1.1 Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1n8T7Pr2Pker1CafSEPAIyLMs2nxKurC6CR1-xVMYcUts_mr3rP_G-fvlhZFI7xt5rbxzbGmuOn49tYjRsfddmM_g60Of4Uldb2xEIMzIO0OL7ix7kMrt3OsENl_BSXSCiuYZXDU8e0Zh0IoC6vTdl2kC9Bp600fe9wK_N66WQg-Eg Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:58:53.944217 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23ff9f71e16d460781dd5889d784b4a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23ff9f71e16d460781dd5889d784b4a3", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 23ff9f71e16d460781dd5889d784b4a3 Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068004336 Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 454a193b26684746bc8c9278a1f1f175 Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-2068004336-project Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.946460 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'c6690e73-5f4a-4c80-89f4-86b6b13e85b3'} Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:53.947819 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. Aug 31 12:58:53.949864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:53.952184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] Returning 404 to user: Instance c6690e73-5f4a-4c80-89f4-86b6b13e85b3 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:53.952184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-261d1b8a-b587-4860-bd70-1cbec8f44f8f tempest-AttachVolumeTestJSON-2068004336 tempest-AttachVolumeTestJSON-2068004336-project] 10.222.0.27 "GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3" status: 404 len: 111 microversion: 2.1 time: 0.036425 Aug 31 12:58:53.952184 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1528/3066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 12:58:53 2022] GET /compute/v2.1/servers/c6690e73-5f4a-4c80-89f4-86b6b13e85b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:58:59.679605 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a09d651-e1ba-4b1c-8c9a-02e16ce247d2 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Action: 'create', calling method: .version_select at 0x7fe854e38430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-464512990", "metadata": {"Type": "work"}}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a09d651-e1ba-4b1c-8c9a-02e16ce247d2 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Request method failure captured: Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 121 Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1sTXBZCzwhrArpE1xc-aseFWr29-pxPPW5GPJyBybUa1VMEsyqGYs36z3ba84aYh9Fbg4FEdKiNi2NohJKoBL5mLFDCRfzUABI_F4TdoA34q7pVWyXf7OHyYD403dXR0yFmBR6fm4sBy03VUqQzGtKTxs7Mdfbp8VOZRknLrD7V5gc Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:58:59.694446 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b56de3a35d74eee8d4dc20b6ab9ab65", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 9dcc8fb1b37e40e899c66d42278ef144 Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-464512990", "metadata": {"Type": "work"}}} Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: Aug 31 12:58:59.696689 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-464512990', 'metadata': {'Type': 'work'}}}} Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.697830 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:58:59.699884 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:58:59.701808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 12:58:59.701808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.701808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a09d651-e1ba-4b1c-8c9a-02e16ce247d2 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.701808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a09d651-e1ba-4b1c-8c9a-02e16ce247d2 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.158649 Aug 31 12:58:59.701808 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1539/3067] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 31 12:58:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:58:59.708581 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8941622-50f4-4cb8-9b1c-953127a226c1 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Action: 'create', calling method: .version_select at 0x7fe85866cf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1777978512", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8941622-50f4-4cb8-9b1c-953127a226c1 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Request method failure captured: Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 120 Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1sTXBZCzwhrArpE1xc-aseFWr29-pxPPW5GPJyBybUa1VMEsyqGYs36z3ba84aYh9Fbg4FEdKiNi2NohJKoBL5mLFDCRfzUABI_F4TdoA34q7pVWyXf7OHyYD403dXR0yFmBR6fm4sBy03VUqQzGtKTxs7Mdfbp8VOZRknLrD7V5gc Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:58:59.713299 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b56de3a35d74eee8d4dc20b6ab9ab65", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 9dcc8fb1b37e40e899c66d42278ef144 Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1777978512", "metadata": {"Type": "work"}}} Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: Aug 31 12:58:59.716156 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1777978512', 'metadata': {'Type': 'work'}}}} Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi '0' Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.717257 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:58:59.719527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:58:59.721641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 12:58:59.721641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.721641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8941622-50f4-4cb8-9b1c-953127a226c1 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.721641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8941622-50f4-4cb8-9b1c-953127a226c1 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010659 Aug 31 12:58:59.721641 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1529/3068] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 31 12:58:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:58:59.729697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a078d7a7-b94c-46fe-aad8-e06d8839b889 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Action: 'create', calling method: .version_select at 0x7fe854d30e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-300069702", "metadata": {"Type": "work"}}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a078d7a7-b94c-46fe-aad8-e06d8839b889 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Request method failure captured: Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 118 Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1sTXBZCzwhrArpE1xc-aseFWr29-pxPPW5GPJyBybUa1VMEsyqGYs36z3ba84aYh9Fbg4FEdKiNi2NohJKoBL5mLFDCRfzUABI_F4TdoA34q7pVWyXf7OHyYD403dXR0yFmBR6fm4sBy03VUqQzGtKTxs7Mdfbp8VOZRknLrD7V5gc Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:58:59.737879 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b56de3a35d74eee8d4dc20b6ab9ab65", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 9dcc8fb1b37e40e899c66d42278ef144 Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-300069702", "metadata": {"Type": "work"}}} Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: Aug 31 12:58:59.741039 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-300069702', 'metadata': {'Type': 'work'}}}} Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise error Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi '' Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.742154 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 12:58:59.744444 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 12:58:59.746643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 12:58:59.746643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.746643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a078d7a7-b94c-46fe-aad8-e06d8839b889 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.746643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a078d7a7-b94c-46fe-aad8-e06d8839b889 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019205 Aug 31 12:58:59.746643 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1540/3069] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 31 12:58:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 12:58:59.755881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f88a896a-ec84-49c7-b3dd-8bce40d75855 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Calling method '.version_select at 0x7fe8586043a0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:58:59.940996 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-f88a896a-ec84-49c7-b3dd-8bce40d75855 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] HTTP exception thrown: Volume tempest-invalid-1298693281 could not be found. Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f88a896a-ec84-49c7-b3dd-8bce40d75855 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Request method failure captured: Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1298693281 HTTP/1.1 Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1sTXBZCzwhrArpE1xc-aseFWr29-pxPPW5GPJyBybUa1VMEsyqGYs36z3ba84aYh9Fbg4FEdKiNi2NohJKoBL5mLFDCRfzUABI_F4TdoA34q7pVWyXf7OHyYD403dXR0yFmBR6fm4sBy03VUqQzGtKTxs7Mdfbp8VOZRknLrD7V5gc Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:58:59.943713 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b56de3a35d74eee8d4dc20b6ab9ab65", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 9dcc8fb1b37e40e899c66d42278ef144 Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Volume tempest-invalid-1298693281 could not be found. Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': 'tempest-invalid-1298693281'} Aug 31 12:58:59.946528 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1298693281 could not be found. (HTTP 404) (Request-ID: req-ab46fcef-6d5d-4ccc-8956-a5dd9754f517) Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.948520 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:58:59.951644 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1298693281 could not be found. Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:58:59.954002 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1298693281 could not be found. Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1298693281 could not be found. Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f88a896a-ec84-49c7-b3dd-8bce40d75855 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Returning 404 to user: Volume tempest-invalid-1298693281 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f88a896a-ec84-49c7-b3dd-8bce40d75855 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1298693281" status: 404 len: 99 microversion: 2.1 time: 0.194528 Aug 31 12:58:59.956398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1530/3070] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 31 12:58:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1298693281 => generated 99 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 12:58:59.967329 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a2470ae0-14eb-4c6d-8c94-7ca244a57666 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007070 Aug 31 12:58:59.968346 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1541/3071] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Aug 31 12:58:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 12:58:59.979834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7d3b378-f7ae-4b6c-9f18-b1c9cbfd73cd tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004385 Aug 31 12:58:59.980586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1531/3072] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Aug 31 12:58:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 12:58:59.990732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1293dda-e3a1-4fc3-8d2c-c6d2e1a6b52a tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Calling method '.version_select at 0x7fe854e384c0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:00.085641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-c1293dda-e3a1-4fc3-8d2c-c6d2e1a6b52a tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] HTTP exception thrown: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1293dda-e3a1-4fc3-8d2c-c6d2e1a6b52a tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Request method failure captured: Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/os-volumes/b7ca48dd-c3b8-4f6b-8f50-9d153695f412 HTTP/1.1 Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1sTXBZCzwhrArpE1xc-aseFWr29-pxPPW5GPJyBybUa1VMEsyqGYs36z3ba84aYh9Fbg4FEdKiNi2NohJKoBL5mLFDCRfzUABI_F4TdoA34q7pVWyXf7OHyYD403dXR0yFmBR6fm4sBy03VUqQzGtKTxs7Mdfbp8VOZRknLrD7V5gc Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 12:59:00.087698 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b56de3a35d74eee8d4dc20b6ab9ab65", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-1062671925 Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 9dcc8fb1b37e40e899c66d42278ef144 Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'b7ca48dd-c3b8-4f6b-8f50-9d153695f412'} Aug 31 12:59:00.090031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. (HTTP 404) (Request-ID: req-216bb42c-c2c0-4d68-9d20-f363dd93ec2d) Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.090946 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 12:59:00.092104 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 12:59:00.094487 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1293dda-e3a1-4fc3-8d2c-c6d2e1a6b52a tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Returning 404 to user: Volume b7ca48dd-c3b8-4f6b-8f50-9d153695f412 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c1293dda-e3a1-4fc3-8d2c-c6d2e1a6b52a tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/b7ca48dd-c3b8-4f6b-8f50-9d153695f412" status: 404 len: 109 microversion: 2.1 time: 0.102798 Aug 31 12:59:00.095552 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1542/3073] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 31 12:58:59 2022] DELETE /compute/v2.1/os-volumes/b7ca48dd-c3b8-4f6b-8f50-9d153695f412 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 12:59:00.102465 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50cbfd39-a17a-4a1c-8104-adac1785f971 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Calling method '.version_select at 0x7fe8585ee280>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:59:00.133084 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-50cbfd39-a17a-4a1c-8104-adac1785f971 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] HTTP exception thrown: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50cbfd39-a17a-4a1c-8104-adac1785f971 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Request method failure captured: Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-volumes/2468382f-d89e-4796-91b6-6ef1ed39835a HTTP/1.1 Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1sTXBZCzwhrArpE1xc-aseFWr29-pxPPW5GPJyBybUa1VMEsyqGYs36z3ba84aYh9Fbg4FEdKiNi2NohJKoBL5mLFDCRfzUABI_F4TdoA34q7pVWyXf7OHyYD403dXR0yFmBR6fm4sBy03VUqQzGtKTxs7Mdfbp8VOZRknLrD7V5gc Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 12:59:00.135120 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4b56de3a35d74eee8d4dc20b6ab9ab65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4b56de3a35d74eee8d4dc20b6ab9ab65", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-1062671925 Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 4b56de3a35d74eee8d4dc20b6ab9ab65 Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-1062671925 Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 9dcc8fb1b37e40e899c66d42278ef144 Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-1062671925-project Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '2468382f-d89e-4796-91b6-6ef1ed39835a'} Aug 31 12:59:00.137292 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. (HTTP 404) (Request-ID: req-4f56cde7-b89f-465c-9ae2-57e24471e6b0) Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.138739 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 12:59:00.140801 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 12:59:00.142730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50cbfd39-a17a-4a1c-8104-adac1785f971 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] Returning 404 to user: Volume 2468382f-d89e-4796-91b6-6ef1ed39835a could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50cbfd39-a17a-4a1c-8104-adac1785f971 tempest-VolumesNegativeTest-1062671925 tempest-VolumesNegativeTest-1062671925-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/2468382f-d89e-4796-91b6-6ef1ed39835a" status: 404 len: 109 microversion: 2.1 time: 0.038547 Aug 31 12:59:00.144655 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1532/3074] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 31 12:59:00 2022] GET /compute/v2.1/os-volumes/2468382f-d89e-4796-91b6-6ef1ed39835a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:00:14.608210 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:14.609193 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:14.611554 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:00:14.611815 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 13:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Aug 31 13:00:14.613260 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:00:14.613466 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Wed Aug 31 13:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Aug 31 13:00:14.620324 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2084700753", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1853732473", "security_groups": [{"name": "tempest-secgroup-smoke-91613680"}], "block_device_mapping_v2": [{"uuid": "92801105-0a6f-42c9-9daf-54670799e9b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd3933ce-2f4d-4c14-bacd-fbfaa9c0ca4b"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:14.765334 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] validate_networks() for [('dd3933ce-2f4d-4c14-bacd-fbfaa9c0ca4b', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 13:00:15.388564 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:00:15.389181 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:00:15.389718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:00:15.390175 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:00:15.390641 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:00:15.404907 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:15.405575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:15.405853 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:15.406662 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:15.407391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:15.407851 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:15.426626 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 13:00:15.432214 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Getting quotas for user 171b9c24597545a1a5c8388849ef5819 and project b5e2d3e145e04936bf60fe93b5011cc2. Resources: {'instances', 'cores', 'ram'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 13:00:15.506673 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 13:00:15.509507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92801105-0a6f-42c9-9daf-54670799e9b5',volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 13:00:15.693904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-83ce2994-76b8-4b56-9895-ce15558c5b83 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.088082 Aug 31 13:00:15.699498 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1543/3075] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 31 13:00:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:00:15.706227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:15.708187 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:15.711398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:00:15.711398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 13:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 (ip 10.222.0.27) !!! Aug 31 13:00:15.719111 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6fac808b-ee27-441c-9461-cd430b42cbc9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:15.719748 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6fac808b-ee27-441c-9461-cd430b42cbc9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:15.789071 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6fac808b-ee27-441c-9461-cd430b42cbc9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:15.796758 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6fac808b-ee27-441c-9461-cd430b42cbc9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1095 microversion: 2.1 time: 0.093180 Aug 31 13:00:15.797348 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1533/3076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:15 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:16.824718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f91e65b4-25bd-4dc1-891c-dbe404a69afa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:16.825944 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f91e65b4-25bd-4dc1-891c-dbe404a69afa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:16.888670 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f91e65b4-25bd-4dc1-891c-dbe404a69afa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:16.897758 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f91e65b4-25bd-4dc1-891c-dbe404a69afa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1095 microversion: 2.1 time: 0.083101 Aug 31 13:00:16.906528 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1544/3077] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:16 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:00:17.933230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-81f68d64-b14b-4ea5-893f-e87e84db14d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:17.934105 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-81f68d64-b14b-4ea5-893f-e87e84db14d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:17.999808 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-81f68d64-b14b-4ea5-893f-e87e84db14d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:18.011302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-81f68d64-b14b-4ea5-893f-e87e84db14d6 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1095 microversion: 2.1 time: 0.081905 Aug 31 13:00:18.011864 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1534/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:17 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:19.034572 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb66c60f-926f-4ba1-9cca-d8350120da05 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:19.035262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb66c60f-926f-4ba1-9cca-d8350120da05 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:19.094676 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bb66c60f-926f-4ba1-9cca-d8350120da05 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:19.104665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb66c60f-926f-4ba1-9cca-d8350120da05 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1095 microversion: 2.1 time: 0.074132 Aug 31 13:00:19.105258 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1545/3079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:19 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:20.126327 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:20.127130 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:20.137104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:20.137607 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:20.138022 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:20.138793 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:20.139254 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:20.139737 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:20.229377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:20.243272 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0e63771-4336-4443-8f3f-fc491a4edf8f tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1145 microversion: 2.1 time: 0.120763 Aug 31 13:00:20.244031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1535/3080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:20 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1145 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:21.278434 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:21.279728 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:21.292793 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:21.293791 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:21.294646 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:21.296097 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:21.297030 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:21.297933 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:21.412299 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:21.447624 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-16eedc0d-a810-423a-867d-7eb6bcee7ce0 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1201 microversion: 2.1 time: 0.174988 Aug 31 13:00:21.455799 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1546/3081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:21 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1201 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:22.488527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:22.489887 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:22.497615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:22.498115 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:22.498685 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:22.499557 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:22.500023 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:22.500455 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:22.746126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:22.764368 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b76d7e8b-0e22-4fc6-aa77-52638f63176b tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.279363 Aug 31 13:00:22.765668 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1536/3082] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:22 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:23.628687 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-18ec6972-ac74-4064-a4bc-9361c85fbc97 req-e88f4157-18f8-4ecd-98ac-ceed7b8e7785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f671b714-82d0-43f4-8c3d-f1a26e1aa9a1", "tag": "ddf35c90-9469-4b46-8fa6-0434200d0116"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:23.638963 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-18ec6972-ac74-4064-a4bc-9361c85fbc97 req-e88f4157-18f8-4ecd-98ac-ceed7b8e7785 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:23.639541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-18ec6972-ac74-4064-a4bc-9361c85fbc97 req-e88f4157-18f8-4ecd-98ac-ceed7b8e7785 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:23.640055 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-18ec6972-ac74-4064-a4bc-9361c85fbc97 req-e88f4157-18f8-4ecd-98ac-ceed7b8e7785 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:23.652427 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-18ec6972-ac74-4064-a4bc-9361c85fbc97 req-e88f4157-18f8-4ecd-98ac-ceed7b8e7785 service nova] Creating event network-changed:ddf35c90-9469-4b46-8fa6-0434200d0116 for instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 on hv-cinder-85535 Aug 31 13:00:23.658582 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-18ec6972-ac74-4064-a4bc-9361c85fbc97 req-e88f4157-18f8-4ecd-98ac-ceed7b8e7785 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190043 Aug 31 13:00:23.659668 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1547/3083] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:00:23.799995 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:23.800738 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:23.809553 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:23.810104 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:23.810388 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:23.811302 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:23.812029 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:23.812464 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:24.000376 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:24.010417 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73445629-0bae-4977-b3bf-49b8ac70cb45 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.216247 Aug 31 13:00:24.011013 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1537/3084] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:23 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:25.050577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:25.052003 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:25.062217 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:25.062829 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:25.063385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:25.064153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:25.064735 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:25.065229 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:25.249788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:25.261075 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-328b6651-faf6-4934-948c-78819bd13040 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.219114 Aug 31 13:00:25.261960 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1548/3085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:25 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:26.285008 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:26.285728 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:26.293539 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:26.294031 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:26.294482 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:26.295211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:26.295694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:26.297110 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:26.487419 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:26.496429 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0099444f-0251-4fb3-9c4b-d6fe29513ee9 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.215570 Aug 31 13:00:26.497028 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1538/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:26 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:27.521119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:27.522255 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:27.524906 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:27.532957 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:27.533748 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:27.534467 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:27.535360 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:27.535841 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:27.536274 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:27.726380 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:27.742706 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba013b10-273a-459a-a036-9e6b3c612d0c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.226373 Aug 31 13:00:27.743745 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1549/3087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:27 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:28.776872 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:28.777627 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:28.780255 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:28.787265 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:28.787828 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:28.788310 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:28.789080 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:28.789580 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:28.790046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:28.957514 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:28.971684 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dbe62ea5-e7a4-4bef-a1d1-6f6c649847bb tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.198323 Aug 31 13:00:28.972648 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1539/3088] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:28 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:29.996029 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:29.996669 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:29.999073 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=10 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:00:30.005535 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:30.006026 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:30.006477 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:30.007195 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:30.007679 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:30.008106 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:30.169524 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:30.179024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a4970348-6709-409d-8069-00e5e42827ed tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.187002 Aug 31 13:00:30.179756 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1550/3089] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:29 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:31.204158 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:31.204787 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:31.214856 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:31.215769 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:31.216527 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:31.217732 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:31.218506 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:31.219218 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:31.432761 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:31.445377 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a9d6a29f-f1c3-429f-83df-84cc3486c8ad tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.245088 Aug 31 13:00:31.446303 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1540/3090] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:31 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:32.478873 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:32.480031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:32.487719 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:32.488216 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:32.488639 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:32.489453 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:32.490194 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:32.490760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:32.682262 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:32.692215 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c031d43f-7cca-4a60-88f9-c542f73e1067 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.217371 Aug 31 13:00:32.693152 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1551/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:32 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:33.728603 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:33.729624 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:33.738934 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.739694 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.740282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.741148 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:33.741730 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:33.742282 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:33.931802 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:33.940628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-28fe0145-e8fb-4f45-84b4-dce5aa0241c7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.217576 Aug 31 13:00:33.941258 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1541/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:33 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:34.964339 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:34.965233 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:34.974891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:34.975521 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:34.976302 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:34.977398 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:34.978066 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:34.978675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:35.201309 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:35.217072 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2e95c98d-60b8-449e-bcc8-cc5dff232695 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.257954 Aug 31 13:00:35.218445 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1552/3093] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:34 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:35.317962 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-15916152-1cca-4f59-9d15-a8c32a7ef4fb req-fd163145-9e2c-4792-9e2e-f22e3ffb68ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f671b714-82d0-43f4-8c3d-f1a26e1aa9a1", "name": "network-vif-plugged", "status": "completed", "tag": "ddf35c90-9469-4b46-8fa6-0434200d0116"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:35.328888 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-15916152-1cca-4f59-9d15-a8c32a7ef4fb req-fd163145-9e2c-4792-9e2e-f22e3ffb68ab service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:35.329425 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-15916152-1cca-4f59-9d15-a8c32a7ef4fb req-fd163145-9e2c-4792-9e2e-f22e3ffb68ab service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:35.329954 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-15916152-1cca-4f59-9d15-a8c32a7ef4fb req-fd163145-9e2c-4792-9e2e-f22e3ffb68ab service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:35.343848 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-15916152-1cca-4f59-9d15-a8c32a7ef4fb req-fd163145-9e2c-4792-9e2e-f22e3ffb68ab service nova] Creating event network-vif-plugged:ddf35c90-9469-4b46-8fa6-0434200d0116 for instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 on hv-cinder-85535 Aug 31 13:00:35.349674 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-15916152-1cca-4f59-9d15-a8c32a7ef4fb req-fd163145-9e2c-4792-9e2e-f22e3ffb68ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282119 Aug 31 13:00:35.350535 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1542/3094] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:00:36.240730 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:36.241601 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:36.249665 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:36.250228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:36.250675 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:36.251571 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:36.252116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:36.252652 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:36.405949 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:36.416788 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5eadb1d2-0de8-4e24-a3bd-225dc25ec8f8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1265 microversion: 2.1 time: 0.181234 Aug 31 13:00:36.417391 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1553/3095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:36 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:37.440165 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:37.440904 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:37.448881 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.449436 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.449922 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.450707 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.451325 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.451825 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.616072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:37.629067 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-700a5092-ef8e-4071-a928-cb61cf610f2c tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1452 microversion: 2.1 time: 0.194017 Aug 31 13:00:37.629666 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1543/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:37 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:37.651918 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:00:37.652583 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:00:37.660507 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.661017 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.661781 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.663692 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:37.664183 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:37.664619 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:37.820450 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:00:37.829627 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e002abeb-6160-4ab7-935e-bd2149ea1b0e tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1452 microversion: 2.1 time: 0.181845 Aug 31 13:00:37.830221 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1554/3097] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:00:37 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:00:40.321795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ce89bffb-887b-487e-ad3a-a78422c47eda req-400a78a2-90ff-4943-8b55-51a42897ce61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f671b714-82d0-43f4-8c3d-f1a26e1aa9a1", "tag": "ddf35c90-9469-4b46-8fa6-0434200d0116"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:00:40.332755 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ce89bffb-887b-487e-ad3a-a78422c47eda req-400a78a2-90ff-4943-8b55-51a42897ce61 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:00:40.333235 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ce89bffb-887b-487e-ad3a-a78422c47eda req-400a78a2-90ff-4943-8b55-51a42897ce61 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:00:40.334435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ce89bffb-887b-487e-ad3a-a78422c47eda req-400a78a2-90ff-4943-8b55-51a42897ce61 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:00:40.356625 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ce89bffb-887b-487e-ad3a-a78422c47eda req-400a78a2-90ff-4943-8b55-51a42897ce61 service nova] Creating event network-changed:ddf35c90-9469-4b46-8fa6-0434200d0116 for instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 on hv-cinder-85535 Aug 31 13:00:40.366399 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ce89bffb-887b-487e-ad3a-a78422c47eda req-400a78a2-90ff-4943-8b55-51a42897ce61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125557 Aug 31 13:00:40.368905 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1544/3098] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:02:22.321511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:22.323442 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=52 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:22.326198 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=28 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:22.328149 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=52 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 13:02:22.330928 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:02:22.331202 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Wed Aug 31 13:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 31 13:02:22.336501 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:22.337430 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:22.341230 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-97fdbb33-63e1-42bf-af0a-b0ba18eff725 req-5b39e754-6cc3-4ba9-981c-48a216349a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f671b714-82d0-43f4-8c3d-f1a26e1aa9a1", "tag": "ddf35c90-9469-4b46-8fa6-0434200d0116"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:22.351263 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.352116 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.352901 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.354228 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.355013 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.355803 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.359800 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-97fdbb33-63e1-42bf-af0a-b0ba18eff725 req-5b39e754-6cc3-4ba9-981c-48a216349a8e service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.360424 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-97fdbb33-63e1-42bf-af0a-b0ba18eff725 req-5b39e754-6cc3-4ba9-981c-48a216349a8e service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.361126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-97fdbb33-63e1-42bf-af0a-b0ba18eff725 req-5b39e754-6cc3-4ba9-981c-48a216349a8e service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.382064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-97fdbb33-63e1-42bf-af0a-b0ba18eff725 req-5b39e754-6cc3-4ba9-981c-48a216349a8e service nova] Creating event network-changed:ddf35c90-9469-4b46-8fa6-0434200d0116 for instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 on hv-cinder-85535 Aug 31 13:02:22.390683 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-97fdbb33-63e1-42bf-af0a-b0ba18eff725 req-5b39e754-6cc3-4ba9-981c-48a216349a8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067427 Aug 31 13:02:22.392340 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1545/3099] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:22.415126 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:02:22.601511 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-43d9dbcb-2c40-477a-9b35-22d5e90f70c5 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 204 len: 0 microversion: 2.1 time: 0.282257 Aug 31 13:02:22.603065 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1555/3100] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 13:02:22 2022] DELETE /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:02:22.618735 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:22.620834 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:22.632777 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.634000 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.635082 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.636403 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:22.637473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:22.638317 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:22.922192 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:22.937926 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d8fef77e-bf93-4d91-a549-b4500f6d4797 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1576 microversion: 2.1 time: 0.327782 Aug 31 13:02:22.939205 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1546/3101] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:22 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1576 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:23.978283 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:23.979697 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:23.996058 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:23.996979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:23.997828 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:23.999148 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:24.000024 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:24.000802 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:24.288967 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:24.304630 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-33aa2c8e-1637-4412-a541-ec8b8cc2ebfa tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1576 microversion: 2.1 time: 0.334568 Aug 31 13:02:24.305813 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1556/3102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:23 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1576 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:25.352441 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:25.353473 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:25.368336 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.369248 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.370041 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:25.371364 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.372212 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.373211 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:25.534407 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:25.550931 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e1b3d1f9-f74a-40c3-a1c5-ae538483d1f4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1392 microversion: 2.1 time: 0.215250 Aug 31 13:02:25.565461 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1547/3103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:25 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:25.643562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-2f3d7c5b-6fd1-4b3f-a300-daafa1a50e85 req-0d81e846-f37f-4cba-85a4-0246218e452d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f671b714-82d0-43f4-8c3d-f1a26e1aa9a1", "name": "network-vif-deleted", "tag": "ddf35c90-9469-4b46-8fa6-0434200d0116"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:25.661385 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2f3d7c5b-6fd1-4b3f-a300-daafa1a50e85 req-0d81e846-f37f-4cba-85a4-0246218e452d service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:25.662188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2f3d7c5b-6fd1-4b3f-a300-daafa1a50e85 req-0d81e846-f37f-4cba-85a4-0246218e452d service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:25.663015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2f3d7c5b-6fd1-4b3f-a300-daafa1a50e85 req-0d81e846-f37f-4cba-85a4-0246218e452d service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:25.686119 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-2f3d7c5b-6fd1-4b3f-a300-daafa1a50e85 req-0d81e846-f37f-4cba-85a4-0246218e452d service nova] Creating event network-vif-deleted:ddf35c90-9469-4b46-8fa6-0434200d0116 for instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 on hv-cinder-85535 Aug 31 13:02:25.695539 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-2f3d7c5b-6fd1-4b3f-a300-daafa1a50e85 req-0d81e846-f37f-4cba-85a4-0246218e452d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Aug 31 13:02:25.696721 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1557/3104] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:02:26.591485 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:26.592838 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:26.603598 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:26.604586 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:26.605076 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:26.606253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:26.607054 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:26.607826 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:26.668237 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:26.669726 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:26.670628 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:26.671378 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lazy-loading 'fault' on Instance uuid f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 13:02:26.748119 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:26.764945 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1eab1d24-828d-43c1-8df3-019c982fea74 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 200 len: 1231 microversion: 2.1 time: 0.181353 Aug 31 13:02:26.766072 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1548/3105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:26 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 1231 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:27.799139 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:27.800577 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: f671b714-82d0-43f4-8c3d-f1a26e1aa9a1] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:27.811921 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.812648 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.813142 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.814048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:27.814814 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:27.815568 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:27.833279 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] HTTP exception thrown: Instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 could not be found. Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Request method failure captured: Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 HTTP/1.1 Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1ogemiuO9ewAHqTQjX3ajmOJztff8DA3C8mYX_GudCMYuyy85F8Io0itOZ2bg-sghhS7tWNkfL4npVIwfjcJRCiKy-fTfGywFDOiObUo-hRV0FNX4RPwK7qLtshby70wX-qIBQcly6M2ZP3tGAxhaFGajp4VT352ZJGcl_Lbjcw50U Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 13:02:27.836278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b5e2d3e145e04936bf60fe93b5011cc2", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 171b9c24597545a1a5c8388849ef5819 Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 could not be found. Aug 31 13:02:27.838943 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': 'f671b714-82d0-43f4-8c3d-f1a26e1aa9a1'} Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 could not be found. Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:02:27.840359 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 could not be found. Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 could not be found. Aug 31 13:02:27.842562 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:27.844736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Returning 404 to user: Instance f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:02:27.844736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f23a688-fa15-49e9-b888-f0440ea3d2cf tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1" status: 404 len: 111 microversion: 2.1 time: 0.048330 Aug 31 13:02:27.844736 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1558/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:27 2022] GET /compute/v2.1/servers/f671b714-82d0-43f4-8c3d-f1a26e1aa9a1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:02:31.553897 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-8e548cfd-985f-43ef-8667-cbd095448171 req-0d9942ea-b13a-494c-98c2-c290c1d0fe2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e9aa1f-7e21-43c8-91d1-fa5a0c682cad", "tag": "a330fdf1-aad4-47a5-ae8e-263e7d6abb4d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:31.556602 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:31.557966 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:31.568678 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:31.569227 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:31.570278 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8e548cfd-985f-43ef-8667-cbd095448171 req-0d9942ea-b13a-494c-98c2-c290c1d0fe2a service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:31.570914 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8e548cfd-985f-43ef-8667-cbd095448171 req-0d9942ea-b13a-494c-98c2-c290c1d0fe2a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:31.571435 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:31.572043 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8e548cfd-985f-43ef-8667-cbd095448171 req-0d9942ea-b13a-494c-98c2-c290c1d0fe2a service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:31.572276 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:31.573309 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:31.574046 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:31.604153 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-8e548cfd-985f-43ef-8667-cbd095448171 req-0d9942ea-b13a-494c-98c2-c290c1d0fe2a service nova] Creating event network-changed:a330fdf1-aad4-47a5-ae8e-263e7d6abb4d for instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad on hv-cinder-85535 Aug 31 13:02:31.613622 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 13:02:31.615718 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-8e548cfd-985f-43ef-8667-cbd095448171 req-0d9942ea-b13a-494c-98c2-c290c1d0fe2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065561 Aug 31 13:02:31.619440 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1559/3107] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:02:31.785600 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-320d4e55-4dc0-4d82-a690-6aa567c78732 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "DELETE /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 204 len: 0 microversion: 2.1 time: 0.239342 Aug 31 13:02:31.791253 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1549/3108] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 13:02:31 2022] DELETE /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:02:31.797048 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:31.797760 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:31.805025 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:31.808363 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:31.808800 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:31.809759 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:31.810452 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:31.811011 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:32.017883 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:32.032249 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8fcf0f68-ed6d-458f-b22b-69ba26e353d8 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1576 microversion: 2.1 time: 0.238842 Aug 31 13:02:32.033273 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1560/3109] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:31 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:33.067988 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:33.068615 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:33.075766 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:33.076249 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:33.076753 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:33.077658 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:33.078412 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:33.078911 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:33.309810 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:33.319589 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73c7b0a3-bca3-415a-a4e0-0f7358575689 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1576 microversion: 2.1 time: 0.255991 Aug 31 13:02:33.320339 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1550/3110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:33 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:02:34.241584 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-e4c31dc6-d96b-44ea-99ec-0779ce3fca5a req-4580fd05-cd3b-4ab4-9f42-27e651d3fc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e9aa1f-7e21-43c8-91d1-fa5a0c682cad", "name": "network-vif-deleted", "tag": "a330fdf1-aad4-47a5-ae8e-263e7d6abb4d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:02:34.254068 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e4c31dc6-d96b-44ea-99ec-0779ce3fca5a req-4580fd05-cd3b-4ab4-9f42-27e651d3fc21 service nova] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:34.254563 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e4c31dc6-d96b-44ea-99ec-0779ce3fca5a req-4580fd05-cd3b-4ab4-9f42-27e651d3fc21 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:34.255015 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e4c31dc6-d96b-44ea-99ec-0779ce3fca5a req-4580fd05-cd3b-4ab4-9f42-27e651d3fc21 service nova] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:34.268898 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-e4c31dc6-d96b-44ea-99ec-0779ce3fca5a req-4580fd05-cd3b-4ab4-9f42-27e651d3fc21 service nova] Creating event network-vif-deleted:a330fdf1-aad4-47a5-ae8e-263e7d6abb4d for instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad on hv-cinder-85535 Aug 31 13:02:34.275261 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-e4c31dc6-d96b-44ea-99ec-0779ce3fca5a req-4580fd05-cd3b-4ab4-9f42-27e651d3fc21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037798 Aug 31 13:02:34.276054 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1561/3111] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 31 13:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:02:34.341594 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:34.342228 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:34.351960 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:34.352824 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:34.353712 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:34.354570 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:34.355126 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:34.355642 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:34.429462 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171b9c24597545a1a5c8388849ef5819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e2d3e145e04936bf60fe93b5011cc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:02:34.437444 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3547fd7f-7735-4960-92d1-404c491dc3cc tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 200 len: 1225 microversion: 2.1 time: 0.100110 Aug 31 13:02:34.438018 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1551/3112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:34 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:02:35.462891 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:35.464040 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:35.470889 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:35.471390 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:35.471979 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:35.472732 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:35.473164 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:35.473588 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:35.488695 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] HTTP exception thrown: Instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad could not be found. Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Request method failure captured: Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad HTTP/1.1 Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1ogemiuO9ewAHqTQjX3ajmOJztff8DA3C8mYX_GudCMYuyy85F8Io0itOZ2bg-sghhS7tWNkfL4npVIwfjcJRCiKy-fTfGywFDOiObUo-hRV0FNX4RPwK7qLtshby70wX-qIBQcly6M2ZP3tGAxhaFGajp4VT352ZJGcl_Lbjcw50U Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 13:02:35.490383 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b5e2d3e145e04936bf60fe93b5011cc2", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 171b9c24597545a1a5c8388849ef5819 Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad could not be found. Aug 31 13:02:35.492904 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '05e9aa1f-7e21-43c8-91d1-fa5a0c682cad'} Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad could not be found. Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:02:35.494341 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad could not be found. Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad could not be found. Aug 31 13:02:35.496794 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:35.498436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Returning 404 to user: Instance 05e9aa1f-7e21-43c8-91d1-fa5a0c682cad could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:02:35.498436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b14f125-21b3-4bd6-8c2a-b827216dbc33 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad" status: 404 len: 111 microversion: 2.1 time: 0.037525 Aug 31 13:02:35.498436 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1562/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:35 2022] GET /compute/v2.1/servers/05e9aa1f-7e21-43c8-91d1-fa5a0c682cad => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:02:36.038765 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:36.039398 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:36.046113 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:36.046593 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:36.047034 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:36.047773 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:36.048220 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:36.048635 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:36.063423 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] HTTP exception thrown: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Request method failure captured: Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 HTTP/1.1 Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Connection: close Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Host: 10.222.0.27 Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjD1ogemiuO9ewAHqTQjX3ajmOJztff8DA3C8mYX_GudCMYuyy85F8Io0itOZ2bg-sghhS7tWNkfL4npVIwfjcJRCiKy-fTfGywFDOiObUo-hRV0FNX4RPwK7qLtshby70wX-qIBQcly6M2ZP3tGAxhaFGajp4VT352ZJGcl_Lbjcw50U Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Role: member,reader Aug 31 13:02:36.065097 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Roles: member,reader Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b5e2d3e145e04936bf60fe93b5011cc2", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Id: 171b9c24597545a1a5c8388849ef5819 Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: method: > Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: exception: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.066795 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: action_args: {'id': '488801fc-4be4-4482-ac14-1c9b60f77a15'} Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:02:36.067779 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.069863 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.071770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Returning 404 to user: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:02:36.071770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7eae637a-fd3c-407a-a273-e6063102add7 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "DELETE /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 404 len: 111 microversion: 2.1 time: 0.032268 Aug 31 13:02:36.071770 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1552/3114] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 31 13:02:36 2022] DELETE /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:02:36.075575 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:36.076188 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] [instance: 488801fc-4be4-4482-ac14-1c9b60f77a15] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 13:02:36.082469 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:36.082947 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:36.083407 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:36.084179 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Acquiring lock "d768c00b-9249-4c6a-9bd1-79d66da87324" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 13:02:36.084546 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 13:02:36.085031 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Lock "d768c00b-9249-4c6a-9bd1-79d66da87324" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 13:02:36.099805 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] HTTP exception thrown: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Request method failure captured: Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 HTTP/1.1 Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Connection: close Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Host: 10.222.0.27 Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjD1ogemiuO9ewAHqTQjX3ajmOJztff8DA3C8mYX_GudCMYuyy85F8Io0itOZ2bg-sghhS7tWNkfL4npVIwfjcJRCiKy-fTfGywFDOiObUo-hRV0FNX4RPwK7qLtshby70wX-qIBQcly6M2ZP3tGAxhaFGajp4VT352ZJGcl_Lbjcw50U Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Role: member,reader Aug 31 13:02:36.101441 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Roles: member,reader Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b5e2d3e145e04936bf60fe93b5011cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b5e2d3e145e04936bf60fe93b5011cc2", "adminURL": "http://10.222.0.27:8080"}]}] Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Id: b5e2d3e145e04936bf60fe93b5011cc2 Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-871905966 Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Id: 171b9c24597545a1a5c8388849ef5819 Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-871905966-project Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: method: > Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: exception: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.103987 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: action_args: {'id': '488801fc-4be4-4482-ac14-1c9b60f77a15'} Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 13:02:36.105136 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. Aug 31 13:02:36.106864 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 31 13:02:36.108541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Returning 404 to user: Instance 488801fc-4be4-4482-ac14-1c9b60f77a15 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 13:02:36.108541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-daa2cc61-0ece-4e38-b237-1f52964f8a27 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15" status: 404 len: 111 microversion: 2.1 time: 0.031344 Aug 31 13:02:36.108541 dv-cinder-855359-1-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1563/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 31 13:02:36 2022] GET /compute/v2.1/servers/488801fc-4be4-4482-ac14-1c9b60f77a15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:02:37.469026 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4daad867-f39c-4952-9b9d-dd82bdec1bc4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] Calling method '.version_select at 0x7fe8585ee940>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:02:37.511298 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4daad867-f39c-4952-9b9d-dd82bdec1bc4 tempest-TestVolumeBootPattern-871905966 tempest-TestVolumeBootPattern-871905966-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1853732473" status: 202 len: 0 microversion: 2.1 time: 0.045925 Aug 31 13:02:37.513064 dv-cinder-855359-1-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1553/3116] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Aug 31 13:02:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1853732473 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)